2024-03-19T05:43:01.442 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-19T05:43:01.442 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654 --verbose --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} --name vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/orig.config.yaml 2024-03-19T05:43:01.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T05:43:01.576 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654 branch: wip-vshankar-testing-20240307.022905 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} email: vshankar@redhat.com first_in_suite: false job_id: '7610654' kernel: flavor: default kdb: true sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240307.022905 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - slow request - SLOW_OPS - MON_DOWN sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240307.022905 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6045 sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f sleep_before_teardown: 0 subset: 832/1024 suite: fs suite_branch: wip-vshankar-testing-20240307.022905 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhv7qFZyWRdrRw/kQhLCjydPW/ut9Wadvozb5N1CCcNB2M95CrukWaHtca0MwA30ZUD5cuffW1pjmlPgIVM7+k= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBtcYq0LvT3OOwvk04JWyKVOO+iL1IlO1BdewEMONovlw/INthFFF9ocNr0LDRcmAHlmoQHb8T4U7lz7Jd8DvY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-19_04:59:54 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-19T05:43:01.576 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa; will attempt to use it 2024-03-19T05:43:01.577 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks 2024-03-19T05:43:01.577 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-19T05:43:01.579 INFO:teuthology.task.internal:Checking packages... 2024-03-19T05:43:01.601 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f' 2024-03-19T05:43:01.601 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-19T05:43:01.601 INFO:teuthology.packaging:ref: None 2024-03-19T05:43:01.601 INFO:teuthology.packaging:tag: None 2024-03-19T05:43:01.601 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240307.022905 2024-03-19T05:43:01.601 INFO:teuthology.packaging:sha1: b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:43:01.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240307.022905 2024-03-19T05:43:01.942 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1934.gb0ea271b 2024-03-19T05:43:01.944 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-19T05:43:01.951 INFO:teuthology.task.internal:no buildpackages task found 2024-03-19T05:43:01.951 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-19T05:43:01.973 INFO:teuthology.task.internal:Saving configuration 2024-03-19T05:43:01.993 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-19T05:43:02.000 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T05:43:02.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:37:40.481176', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhv7qFZyWRdrRw/kQhLCjydPW/ut9Wadvozb5N1CCcNB2M95CrukWaHtca0MwA30ZUD5cuffW1pjmlPgIVM7+k='} 2024-03-19T05:43:02.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:37:40.479356', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBtcYq0LvT3OOwvk04JWyKVOO+iL1IlO1BdewEMONovlw/INthFFF9ocNr0LDRcmAHlmoQHb8T4U7lz7Jd8DvY='} 2024-03-19T05:43:02.047 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-19T05:43:02.053 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-19T05:43:02.053 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-19T05:43:02.053 INFO:teuthology.run_tasks:Running task console_log... 2024-03-19T05:43:02.129 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c02932160>, signals=[15]) 2024-03-19T05:43:02.130 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-19T05:43:02.136 INFO:teuthology.task.internal:Opening connections... 2024-03-19T05:43:02.136 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T05:43:02.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:43:02.247 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T05:43:02.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:43:02.335 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-19T05:43:02.342 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-03-19T05:43:02.360 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-03-19T05:43:02.360 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-03-19T05:43:02.417 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-03-19T05:43:02.417 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-03-19T05:43:02.417 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T05:43:02.418 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T05:43:02.419 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-03-19T05:43:02.447 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-03-19T05:43:02.463 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-03-19T05:43:02.464 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-19T05:43:02.520 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-03-19T05:43:02.520 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-03-19T05:43:02.520 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T05:43:02.521 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T05:43:02.522 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-19T05:43:02.539 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-19T05:43:02.547 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-19T05:43:02.553 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-19T05:43:02.553 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-03-19T05:43:02.556 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-03-19T05:43:02.576 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-19T05:43:02.584 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-19T05:43:02.584 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-03-19T05:43:02.613 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-03-19T05:43:02.648 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-19T05:43:02.707 INFO:teuthology.run_tasks:Running task kernel... 2024-03-19T05:43:02.721 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'} 2024-03-19T05:43:02.721 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}}, timeout 300 2024-03-19T05:43:02.722 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T05:43:02.722 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-19T05:43:02.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:43:02.738 DEBUG:teuthology.task.kernel:sha1 for mon.b is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.738 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T05:43:02.738 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-19T05:43:02.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:43:02.739 DEBUG:teuthology.task.kernel:sha1 for mon.a is 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.739 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "908b6b276e8f14e16032b32a9770077cd37b6bd4"... 2024-03-19T05:43:02.739 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-19T05:43:02.794 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-361.el9.x86_64 2024-03-19T05:43:02.795 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.795 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T05:43:02.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.799 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-361.el9.x86_64 2024-03-19T05:43:02.799 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.799 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-19T05:43:02.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:02.936 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum upgrade -y linux-firmware 2024-03-19T05:43:03.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2024-03-19T05:43:05.360 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.7 MB 00:00 2024-03-19T05:43:05.501 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 8.4 MB/s | 6.7 MB 00:00 2024-03-19T05:43:07.061 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-03-19T05:43:07.209 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-03-19T05:43:09.125 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.0 MB 00:01 2024-03-19T05:43:09.184 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-03-19T05:43:13.552 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-03-19T05:43:13.717 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 19 MB 00:03 2024-03-19T05:43:18.852 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-03-19T05:43:18.901 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.1 MB 00:01 2024-03-19T05:43:20.410 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-03-19T05:43:21.502 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 16 kB 00:01 2024-03-19T05:43:24.631 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 21 MB 00:04 2024-03-19T05:43:28.847 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 21 MB 00:07 2024-03-19T05:43:29.678 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-03-19T05:43:31.946 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 1 Package 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:43:31.953 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 375 M 2024-03-19T05:43:31.954 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-19T05:43:33.752 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-03-19T05:43:35.991 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-19T05:43:36.002 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 1 Package 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 375 M 2024-03-19T05:43:36.003 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-19T05:43:43.537 INFO:teuthology.orchestra.run.smithi017.stdout:linux-firmware-20240219-143.el9.noarch.rpm 32 MB/s | 375 MB 00:11 2024-03-19T05:43:43.538 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:43:43.539 INFO:teuthology.orchestra.run.smithi017.stdout:Total 32 MB/s | 375 MB 00:11 2024-03-19T05:43:43.539 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-19T05:43:43.617 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-19T05:43:43.617 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-19T05:43:45.111 INFO:teuthology.orchestra.run.smithi153.stdout:linux-firmware-20240219-143.el9.noarch.rpm 41 MB/s | 375 MB 00:09 2024-03-19T05:43:45.112 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:43:45.113 INFO:teuthology.orchestra.run.smithi153.stdout:Total 41 MB/s | 375 MB 00:09 2024-03-19T05:43:45.113 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-19T05:43:45.209 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-19T05:43:45.209 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-19T05:43:46.129 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-19T05:43:46.130 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-19T05:43:47.683 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-19T05:43:47.683 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-19T05:43:52.693 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-19T05:43:52.893 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:43:52.980 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:53.854 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-19T05:43:54.094 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:43:54.177 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:54.204 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:54.205 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:43:54.582 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-19T05:43:54.852 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.a... 2024-03-19T05:43:54.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:55.006 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ 2024-03-19T05:43:55.006 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-19T05:43:55.009 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2024-03-19T05:43:55.370 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:55.370 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:43:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-19T05:43:56.011 INFO:teuthology.task.kernel:Downloading kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.b... 2024-03-19T05:43:56.012 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=908b6b276e8f14e16032b32a9770077cd37b6bd4 2024-03-19T05:43:56.163 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ 2024-03-19T05:43:56.164 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-19T05:43:56.166 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2024-03-19T05:45:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19 05:45:38 URL:https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm [336362676/336362676] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-19T05:45:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2024-03-19 05:45:38-- 2024-03-19T05:45:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 1m 43s 2024-03-19T05:45:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 321M in 1m 42s (3.14 MB/s) 2024-03-19T05:45:38.852 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.b... 2024-03-19T05:45:38.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-19T05:45:40.829 INFO:teuthology.orchestra.run.smithi153.stdout:Verifying... ######################################## 2024-03-19T05:45:40.893 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing... ######################################## 2024-03-19T05:45:40.973 INFO:teuthology.orchestra.run.smithi153.stdout:Updating / installing... 2024-03-19T05:45:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19 05:45:47 URL:https://2.chacra.ceph.com/r/kernel/testing/908b6b276e8f14e16032b32a9770077cd37b6bd4/centos/9/flavors/default/x86_64/kernel-6.8.0_g908b6b276e8f-1.x86_64.rpm [336362676/336362676] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-19T05:45:47.938 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2024-03-19 05:45:47-- 2024-03-19T05:45:47.938 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 1m 53s 2024-03-19T05:45:47.938 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 321M in 1m 52s (2.86 MB/s) 2024-03-19T05:45:47.941 INFO:teuthology.task.kernel:Installing kernel 908b6b276e8f14e16032b32a9770077cd37b6bd4 on mon.a... 2024-03-19T05:45:47.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-19T05:45:48.478 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-6.8.0_g908b6b276e8f-1 ######################################## 2024-03-19T05:45:49.974 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2024-03-19T05:45:50.039 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2024-03-19T05:45:50.124 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2024-03-19T05:45:57.962 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.8.0_g908b6b276e8f-1 ######################################## 2024-03-19T05:46:02.954 INFO:teuthology.orchestra.run.smithi153.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-19T05:46:12.170 INFO:teuthology.orchestra.run.smithi017.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-19T05:46:25.298 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-19T05:46:25.298 DEBUG:teuthology.orchestra.run.smithi153:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/System.map 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/config 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch 2024-03-19T05:46:25.363 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T05:46:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T05:46:25.365 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T05:46:25.366 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T05:46:25.367 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T05:46:25.368 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T05:46:25.369 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/custom_method.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ata_generic.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T05:46:25.370 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T05:46:25.371 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T05:46:25.372 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sis.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T05:46:25.373 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T05:46:25.374 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/brd.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/loop.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T05:46:25.375 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/virtio_blk.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkfront.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T05:46:25.376 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T05:46:25.377 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/uv_mmtimer.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/virtio_console.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T05:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-19T05:46:25.379 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T05:46:25.380 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/edd.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T05:46:25.381 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T05:46:25.382 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T05:46:25.383 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T05:46:25.384 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T05:46:25.385 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T05:46:25.386 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T05:46:25.387 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T05:46:25.388 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T05:46:25.389 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T05:46:25.390 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T05:46:25.391 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T05:46:25.392 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T05:46:25.393 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T05:46:25.394 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T05:46:25.395 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T05:46:25.396 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-dev.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T05:46:25.397 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib 2024-03-19T05:46:25.398 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T05:46:25.399 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T05:46:25.400 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T05:46:25.401 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T05:46:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T05:46:25.403 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mfd-core.ko 2024-03-19T05:46:25.404 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T05:46:25.405 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T05:46:25.406 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net 2024-03-19T05:46:25.407 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T05:46:25.408 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon 2024-03-19T05:46:25.409 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T05:46:25.410 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna 2024-03-19T05:46:25.411 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T05:46:25.412 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T05:46:25.413 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf 2024-03-19T05:46:25.414 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T05:46:25.415 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T05:46:25.416 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc 2024-03-19T05:46:25.417 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T05:46:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T05:46:25.419 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154 2024-03-19T05:46:25.420 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/net_failover.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T05:46:25.421 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/dp83640.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T05:46:25.422 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-19T05:46:25.423 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T05:46:25.425 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T05:46:25.425 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T05:46:25.425 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T05:46:25.425 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T05:46:25.425 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slhc.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tun.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T05:46:25.426 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/virtio_net.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netfront.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport 2024-03-19T05:46:25.427 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T05:46:25.428 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T05:46:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T05:46:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T05:46:25.431 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T05:46:25.432 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T05:46:25.433 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx 2024-03-19T05:46:25.434 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T05:46:25.435 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T05:46:25.436 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci 2024-03-19T05:46:25.437 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T05:46:25.438 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T05:46:25.439 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb 2024-03-19T05:46:25.440 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel 2024-03-19T05:46:25.441 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T05:46:25.442 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T05:46:25.443 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class 2024-03-19T05:46:25.444 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T05:46:25.445 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy 2024-03-19T05:46:25.446 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T05:46:25.447 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T05:46:25.448 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T05:46:25.449 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T05:46:25.450 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T05:46:25.451 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_balloon.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_mmio.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_ring.ko 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1 2024-03-19T05:46:25.452 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T05:46:25.453 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T05:46:25.454 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T05:46:25.455 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T05:46:25.456 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T05:46:25.457 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/fat.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/vfat.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/fuse.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs 2024-03-19T05:46:25.458 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout 2024-03-19T05:46:25.459 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T05:46:25.460 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T05:46:25.461 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T05:46:25.462 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2 2024-03-19T05:46:25.463 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T05:46:25.464 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T05:46:25.465 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu/rcutorture.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/asn1_encoder.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T05:46:25.466 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T05:46:25.467 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd/zstd_compress.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T05:46:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge 2024-03-19T05:46:25.469 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T05:46:25.470 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T05:46:25.471 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/failover.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver/dns_resolver.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T05:46:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T05:46:25.473 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T05:46:25.474 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T05:46:25.475 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T05:46:25.476 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T05:46:25.477 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T05:46:25.478 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T05:46:25.479 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T05:46:25.480 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T05:46:25.481 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T05:46:25.482 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T05:46:25.483 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T05:46:25.484 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_quota.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tunnel.ko 2024-03-19T05:46:25.485 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T05:46:25.486 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T05:46:25.487 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T05:46:25.488 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T05:46:25.489 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T05:46:25.490 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T05:46:25.491 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T05:46:25.492 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T05:46:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T05:46:25.494 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T05:46:25.495 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys 2024-03-19T05:46:25.496 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys/trusted.ko 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T05:46:25.497 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T05:46:25.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T05:46:25.498 INFO:teuthology.orchestra.run.smithi153.stdout:/lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:46:25.502 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T05:46:25.502 DEBUG:teuthology.orchestra.run.smithi153:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:postinstall scriptlet (using /bin/sh): 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/bin/kernel-install add 6.8.0-g908b6b276e8f /lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:for file in vmlinuz System.map config; do 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: if ! cmp --silent "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f"; then 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: cp "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f" 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout: fi 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:new-kernel-pkg --remove 6.8.0-g908b6b276e8f --rminitrd --initrdfile=/boot/initramfs-6.8.0-g908b6b276e8f.img 2024-03-19T05:46:25.524 INFO:teuthology.orchestra.run.smithi153.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-install remove 6.8.0-g908b6b276e8f 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:/sbin/update-bootloader --remove 6.8.0-g908b6b276e8f 2024-03-19T05:46:25.525 INFO:teuthology.orchestra.run.smithi153.stdout:fi 2024-03-19T05:46:25.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-03-19T05:46:25.598 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 68.el9 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8264254 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-19T05:46:25.599 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:46:25.600 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-03-19T05:46:25.601 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-19T05:46:25.601 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 6.8.0-g908b6b276e8f 2024-03-19T05:46:25.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-19T05:46:26.184 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-03-19T05:46:27.553 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-19T05:46:27.588 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-03-19T05:46:27.591 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-19T05:46:27.605 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.czuehP0eXV 2024-03-19T05:46:27.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.czuehP0eXV 2024-03-19T05:46:27.680 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.czuehP0eXV 2024-03-19T05:46:27.818 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.czuehP0eXV is 6KB 2024-03-19T05:46:27.868 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.czuehP0eXV 2024-03-19T05:46:27.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-03-19T05:46:27.952 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-19T05:46:27.952 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-19T05:46:27.952 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-19T05:46:27.952 INFO:teuthology.orchestra.run.smithi153.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f.conf 2024-03-19T05:46:27.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f 2024-03-19T05:46:28.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-03-19T05:46:35.674 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-19T05:46:35.674 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-19T05:46:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f 2024-03-19T05:46:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/System.map 2024-03-19T05:46:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/config 2024-03-19T05:46:35.751 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-19T05:46:35.752 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-19T05:46:35.753 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/arch/x86/kvm/kvm.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ansi_cprng.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/anubis.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/arc4.ko 2024-03-19T05:46:35.754 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_memcpy.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_pq.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_tx.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/async_xor.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/async_tx/raid6test.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authenc.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/authencesn.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blake2b_generic.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_common.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/blowfish_generic.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/camellia_generic.ko 2024-03-19T05:46:35.755 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast5_generic.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast6_generic.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cast_common.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/ccm.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cmac.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crc32_generic.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_engine.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/crypto_user.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/cts.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/des_generic.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/dh_generic.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/echainiv.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/essiv.ko 2024-03-19T05:46:35.756 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/fcrypt.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/khazad.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/lz4hc.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/md4.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/michael_mic.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcbc.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/pcrypt.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/rmd160.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/seed.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/serpent_generic.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tcrypt.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/tea.ko 2024-03-19T05:46:35.757 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_common.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/twofish_generic.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/vmac.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/wp512.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xcbc.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xor.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/crypto/xxhash_generic.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/acpi_pad.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/custom_method.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/ec_sys.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/platform_profile.ko 2024-03-19T05:46:35.758 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbs.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/sbshc.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/acpi/video.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/acard-ahci.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ahci_platform.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/ata_generic.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/libahci_platform.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_acpi.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ali.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_amd.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_artop.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atiixp.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_atp867x.ko 2024-03-19T05:46:35.759 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd640.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cmd64x.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_cypress.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_efar.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt366.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt37x.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it8213.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_it821x.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_jmicron.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_marvell.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_mpiix.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_netcell.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ninja32.ko 2024-03-19T05:46:35.760 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87410.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_ns87415.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_oldpiix.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_opti.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_optidma.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pcmcia.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_piccolo.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_rdc.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sch.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_serverworks.ko 2024-03-19T05:46:35.761 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sil680.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sis.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_sl82c105.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_triflex.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pata_via.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/pdc_adma.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_inic162x.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_mv.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_nv.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_promise.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_qstor.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sil24.ko 2024-03-19T05:46:35.762 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sis.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_svw.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_sx4.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_uli.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_via.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ata/sata_vsc.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/auxdisplay/ks0108.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/bcma/bcma.ko 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block 2024-03-19T05:46:35.763 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/aoe/aoe.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/brd.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/drbd/drbd.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/floppy.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/loop.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/nbd.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/null_blk/null_blk.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/pktcdvd.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/rbd.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/virtio_blk.ko 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback 2024-03-19T05:46:35.764 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/xen-blkfront.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/block/zram/zram.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hangcheck-timer.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/via-rng.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-19T05:46:35.765 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/lp.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/mwave/mwave.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/ppdev.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tlclk.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm.ko 2024-03-19T05:46:35.766 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/uv_mmtimer.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/char/virtio_console.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-19T05:46:35.767 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/ccp/ccp.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-aes.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/padlock-sha.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-19T05:46:35.768 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dca/dca.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/amd64_edac.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/e752x_edac.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/edac_mce_amd.ko 2024-03-19T05:46:35.769 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3000_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i3200_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5100_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i5400_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7300_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i7core_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/i82975x_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/ie31200_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/sb_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/edac/x38_edac.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/edd.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-19T05:46:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-ich.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-appleir.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-aureal.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-axff.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-dr.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elecom.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-elo.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-emsff.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gaff.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gt683r.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-gyration.ko 2024-03-19T05:46:35.771 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-holtekff.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-hyperv.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-icade.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-keytouch.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-kye.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lcpower.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-led.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-lenovo.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-multitouch.ko 2024-03-19T05:46:35.772 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-ortek.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-penmount.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-petalynx.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-picolcd.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-pl.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-plantronics.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-primax.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-rmi.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-common.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-19T05:46:35.773 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-roccat.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-saitek.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-samsung.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sjoy.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sony.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-speedlink.ko 2024-03-19T05:46:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-steelseries.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-sunplus.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tivo.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-tmff.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-topseed.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-twinhan.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-uclogic.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-waltop.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-wiimote.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-xinmo.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zpff.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/hid-zydacron.ko 2024-03-19T05:46:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/uhid.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hid/wacom.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_balloon.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_utils.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hv/hv_vmbus.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/abituguru3.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7414.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ad7418.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adc128d818.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1025.ko 2024-03-19T05:46:35.776 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1026.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1029.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm1031.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adm9240.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ads7828.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7410.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7411.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7462.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7470.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7475.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/adt7x10.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/amc6821.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/applesmc.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asb100.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asc7621.ko 2024-03-19T05:46:35.777 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/atxp1.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/coretemp.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/dme1737.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds1621.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ds620.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc1403.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/emc6w201.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71805f.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f71882fg.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/f75375s.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fam15h_power.ko 2024-03-19T05:46:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/fschmd.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g760a.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/g762.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl518sm.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/gl520sm.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5500_temp.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/i5k_amb.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmaem.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ibmpex.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina209.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ina2xx.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/it87.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k10temp.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/k8temp.ko 2024-03-19T05:46:35.779 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lineage-pem.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm63.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm73.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm75.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm77.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm78.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm80.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm83.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm85.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm87.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm90.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm92.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm93.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95234.ko 2024-03-19T05:46:35.780 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95241.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/lm95245.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc2945.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4151.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4215.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4222.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4245.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4260.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/ltc4261.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max16065.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1619.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max1668.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max197.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6639.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6650.ko 2024-03-19T05:46:35.781 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/max6697.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/mcp3021.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6683.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775-core.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct6775.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/nct7802.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87360.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pc87427.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pcf8591.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-19T05:46:35.782 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/powr1220.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5627.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch5636.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht15.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sht21.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/shtc1.ko 2024-03-19T05:46:35.783 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/sis5595.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47b397.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m1.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/smsc47m192.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/thmc50.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp102.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp103.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp401.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/tmp421.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via-cputemp.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/via686a.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt1211.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/vt8231.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627ehf.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83627hf.ko 2024-03-19T05:46:35.784 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83781d.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83791d.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83792d.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83793.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83795.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l785ts.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/hwmon/w83l786ng.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-19T05:46:35.785 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-19T05:46:35.786 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-dev.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-mux.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-smbus.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/i2c/i2c-stub.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_core.ko 2024-03-19T05:46:35.787 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca 2024-03-19T05:46:35.788 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport 2024-03-19T05:46:35.789 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/gameport/gameport.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/joydev.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/appletouch.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/bcm5974.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/cyapatp.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/sermouse.ko 2024-03-19T05:46:35.790 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/altera_ps2.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/arc_ps2.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/serio/serio_raw.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/input/sparse-keymap.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-blinkm.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lm3530.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-lp3944.ko 2024-03-19T05:46:35.791 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/leds-ss4200.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/bcache/bcache.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-bio-prison.ko 2024-03-19T05:46:35.792 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache-smq.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-cache.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-crypt.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-delay.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-flakey.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-log-userspace.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-multipath.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-queue-length.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-raid.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-round-robin.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-service-time.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-switch.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-thin-pool.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/dm-verity.ko 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data 2024-03-19T05:46:35.793 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid0.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid1.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid10.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/md/raid456.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptbase.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptctl.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptfc.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptlan.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptsas.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptscsih.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/message/fusion/mptspi.ko 2024-03-19T05:46:35.794 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_ich.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/lpc_sch.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/mfd-core.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/sm501.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/viperboard.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/vx855.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/mfd/wl1273-core.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds9802als.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/apds990x.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/bh1770glc.ko 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710 2024-03-19T05:46:35.795 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/cb710/cb710.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/at24.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/eeprom/max6875.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/enclosure.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/hpilo.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29003.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/isl29020.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-me.ko 2024-03-19T05:46:35.796 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei-txe.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/mei/mei.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_7xx1.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tifm_core.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/tsl2550.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_balloon.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-19T05:46:35.797 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/bonding/bonding.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/dummy.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/eql.ko 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet 2024-03-19T05:46:35.798 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon 2024-03-19T05:46:35.799 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx 2024-03-19T05:46:35.800 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-19T05:46:35.801 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic 2024-03-19T05:46:35.802 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/dnet.ko 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex 2024-03-19T05:46:35.803 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ethoc.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/fealnx.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e 2024-03-19T05:46:35.804 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/jme.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-19T05:46:35.805 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-19T05:46:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc 2024-03-19T05:46:35.807 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-19T05:46:35.808 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-19T05:46:35.809 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-19T05:46:35.810 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/geneve.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ifb.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvlan.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/macvtap.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-19T05:46:35.811 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/mii.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/net_failover.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/netconsole.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/nlmon.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/amd.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/bcm87xx.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/broadcom.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/cicada.ko 2024-03-19T05:46:35.812 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/davicom.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/dp83640.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/et1011c.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/icplus.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/lxt.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/marvell.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/micrel.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/national.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/phylink.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/qsemi.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/realtek.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/smsc.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/ste10Xp.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/phy/vitesse.ko 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp 2024-03-19T05:46:35.813 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_async.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppoe.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pppox.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/ppp/pptp.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slhc.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/slip/slip.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/sungem_phy.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tap.ko 2024-03-19T05:46:35.814 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_random.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/tun.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/veth.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/virtio_net.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/vxlan/vxlan.ko 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback 2024-03-19T05:46:35.815 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/net/xen-netfront.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ntb/ntb.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme-core.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/nvme/host/nvme.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_cs.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_pc.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/parport/parport_serial.ko 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug 2024-03-19T05:46:35.816 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pci/xen-pcifront.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/i82092.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/pd6729.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86 2024-03-19T05:46:35.817 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/acerhdf.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/hdaps.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-19T05:46:35.818 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/intel_ips.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/platform/x86/wmi.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-19T05:46:35.819 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/clients/pps_parport.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/pps/pps_core.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ptp/ptp_kvm.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-19T05:46:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-em3027.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-max6900.ko 2024-03-19T05:46:35.821 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/rtc/rtc-x1205.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-9xxx.ko 2024-03-19T05:46:35.822 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-sas.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/3w-xxxx.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/BusLogic.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/a100u2w.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/advansys.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/am53c974.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/atp870u.ko 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi 2024-03-19T05:46:35.823 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bfa/bfa.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ch.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-19T05:46:35.824 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dc395x.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/dmx3191d.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/esp_scsi.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-19T05:46:35.825 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/fnic/fnic.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hpsa.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hptiop.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/hv_storvsc.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/initio.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ipr.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ips.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/isci/isci.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-19T05:46:35.826 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libfc/libfc.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/libsas/libsas.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-19T05:46:35.827 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/mvumi.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/pmcraid.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla1280.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-19T05:46:35.828 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/raid_class.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_debug.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/ses.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/st.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/stex.ko 2024-03-19T05:46:35.829 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/virtio_scsi.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/scsi/wd719x.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ssb/ssb.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_file.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_iblock.ko 2024-03-19T05:46:35.830 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_mod.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_pscsi.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/target_core_user.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-19T05:46:35.831 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-19T05:46:35.832 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_gsm.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/n_hdlc.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/nozomi.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/arc_uart.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs 2024-03-19T05:46:35.833 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_aec.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_cif.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_pci_generic.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/uio/uio_sercos3.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-acm.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-19T05:46:35.834 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usblp.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/class/usbtmc.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/mdc800.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/image/microtek.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/adutux.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/appledisplay.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi26.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/emi62.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ezusb.ko 2024-03-19T05:46:35.835 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/idmouse.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/iowarrior.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/ldusb.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/legousbtower.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usb3503.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usblcd.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/uss720.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/misc/yurex.ko 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy 2024-03-19T05:46:35.836 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/phy/phy-generic.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/aircable.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ark3116.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ch341.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cp210x.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cyberjack.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/empeg.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-19T05:46:35.837 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/io_ti.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipaq.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ipw.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ir-usb.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mct_u232.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7720.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/mos7840.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/navman.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/omninet.ko 2024-03-19T05:46:35.838 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/opticon.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/option.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/oti6858.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/pl2303.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcaux.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/qcserial.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/quatech2.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/safe_serial.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/sierra.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ssu100.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/symbolserial.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-19T05:46:35.839 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_debug.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/visor.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/whiteheat.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/uas.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-19T05:46:35.840 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-karma.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/storage/usb-storage.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-19T05:46:35.841 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_net.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/vhost/vhost_scsi.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/apple_bl.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/lcd.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio.ko 2024-03-19T05:46:35.842 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_balloon.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_mmio.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/virtio/virtio_ring.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2482.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/masters/ds2490.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-19T05:46:35.843 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/w1/wire.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/hpwdt.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/i6300esb.ko 2024-03-19T05:46:35.844 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ib700wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ibmasr.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/it87_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/machzwd.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/nv_tco.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/softdog.ko 2024-03-19T05:46:35.845 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/via_wdt.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/wdt_pci.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/watchdog/xen_wdt.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-evtchn.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntalloc.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-gntdev.ko 2024-03-19T05:46:35.846 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xen-privcmd.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/9p/9p.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/affs/affs.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/befs/befs.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/binfmt_misc.ko 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs 2024-03-19T05:46:35.847 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/btrfs/btrfs.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cachefiles/cachefiles.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ceph/ceph.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/coda/coda.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/cramfs/cramfs.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/dlm/dlm.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs 2024-03-19T05:46:35.848 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/f2fs/f2fs.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/fat.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/msdos.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fat/vfat.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/cuse.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/fuse/fuse.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/gfs2/gfs2.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfs/hfs.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/hfsplus/hfsplus.ko 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs 2024-03-19T05:46:35.849 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/isofs/isofs.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/jfs/jfs.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/lockd/lockd.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/minix/minix.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/netfs/netfs.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout 2024-03-19T05:46:35.850 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfs.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv3.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs/nfsv4.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/grace.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfs_common/nfs_acl.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nfsd/nfsd.ko 2024-03-19T05:46:35.851 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2 2024-03-19T05:46:35.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nilfs2/nilfs2.ko 2024-03-19T05:46:35.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls 2024-03-19T05:46:35.853 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-celtic.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-centeuro.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-croatian.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-cyrillic.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-gaelic.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-greek.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-iceland.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-inuit.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-roman.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-romanian.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/mac-turkish.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1250.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1251.ko 2024-03-19T05:46:35.854 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp1255.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp737.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp775.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp850.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp852.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp855.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp857.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp860.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp861.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp862.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp863.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp864.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp865.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp866.ko 2024-03-19T05:46:35.855 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp869.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp874.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp932.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp936.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp949.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_cp950.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_euc-jp.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-1.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-13.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-14.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-15.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-2.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-3.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-4.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-5.ko 2024-03-19T05:46:35.856 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-6.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-7.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_iso8859-9.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-r.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-ru.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_koi8-u.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/nls/nls_utf8.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs 2024-03-19T05:46:35.857 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/overlayfs/overlay.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/pstore/ramoops.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/reiserfs/reiserfs.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/romfs/romfs.ko 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb 2024-03-19T05:46:35.858 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/client/cifs.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_arc4.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/smb/common/cifs_md4.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/squashfs/squashfs.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/sysv/sysv.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/udf/udf.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/ufs/ufs.ko 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs 2024-03-19T05:46:35.859 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/fs/xfs/xfs.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/rcu/rcutorture.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/torture.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/asn1_encoder.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc-itu-t.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crc8.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libarc4.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/crypto/libdes.ko 2024-03-19T05:46:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/libcrc32c.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lru_cache.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4_compress.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/lz4/lz4hc_compress.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/math/cordic.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/raid6/raid6_pq.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_bm.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_fsm.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/ts_kmp.ko 2024-03-19T05:46:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/lib/zstd/zstd_compress.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/mm/hwpoison-inject.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/6lowpan.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_dest.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_fragment.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_hop.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_mobility.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_routing.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/6lowpan/nhc_udp.ko 2024-03-19T05:46:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/garp.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/mrp.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/p8022.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/psnap.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/802/stp.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/8021q/8021q.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_fd.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_rdma.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/9p/9pnet_virtio.ko 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv 2024-03-19T05:46:35.863 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/batman-adv/batman-adv.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/br_netfilter.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/bridge.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-19T05:46:35.864 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/ebtables.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-19T05:46:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ceph/libceph.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/failover.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/core/pktgen.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_diag.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv4.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dccp/dccp_ipv6.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dns_resolver/dns_resolver.ko 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa 2024-03-19T05:46:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/dsa_core.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_brcm.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_dsa.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_none.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/dsa/tag_trailer.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ah4.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/esp4.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/fou.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/gre.ko 2024-03-19T05:46:35.867 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/inet_diag.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_gre.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_tunnel.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ip_vti.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipcomp.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/ipip.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-19T05:46:35.868 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_bic.ko 2024-03-19T05:46:35.869 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_dctcp.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_diag.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_highspeed.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_htcp.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_hybla.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_illinois.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_lp.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_scalable.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_vegas.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_veno.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_westwood.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tcp_yeah.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/tunnel4.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_diag.ko 2024-03-19T05:46:35.870 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/udp_tunnel.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ah6.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/esp6.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/fou6.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_tunnel.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ip6_vti.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/ipcomp6.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-19T05:46:35.871 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-19T05:46:35.872 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/sit.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/tunnel6.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/key/af_key.ko 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp 2024-03-19T05:46:35.873 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_core.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_eth.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ip6.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_netlink.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/l2tp/l2tp_ppp.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/llc/llc.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mac802154/mac802154.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/mpls/mpls_gso.ko 2024-03-19T05:46:35.874 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-19T05:46:35.875 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-19T05:46:35.876 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conncount.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-19T05:46:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_log_syslog.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_irc.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_sip.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-19T05:46:35.878 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nf_tables.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_log.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_chain_nat.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_compat.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_ct.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fib.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_hash.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_limit.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_log.ko 2024-03-19T05:46:35.879 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_masq.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_nat.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_numgen.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_queue.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_quota.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_redir.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_reject_inet.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_socket.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/nft_tunnel.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_AUDIT.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_CT.ko 2024-03-19T05:46:35.880 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_DSCP.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HL.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_HMARK.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LED.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_LOG.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NETMAP.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFLOG.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_RATEEST.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-19T05:46:35.881 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_SECMARK.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TEE.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TPROXY.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_TRACE.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_addrtype.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_bpf.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cgroup.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cluster.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_comment.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connbytes.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlabel.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connlimit.ko 2024-03-19T05:46:35.882 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_connmark.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_conntrack.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_cpu.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dccp.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_devgroup.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_dscp.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ecn.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_esp.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hashlimit.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_helper.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_hl.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipcomp.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_iprange.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_ipvs.ko 2024-03-19T05:46:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_l2tp.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_length.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_limit.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mac.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_mark.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_multiport.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nat.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_nfacct.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_osf.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_owner.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_physdev.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_pkttype.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_policy.ko 2024-03-19T05:46:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_quota.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_rateest.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_realm.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_recent.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_sctp.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_set.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_socket.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_state.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_statistic.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_string.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_tcpmss.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_time.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netfilter/xt_u32.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/netlink/netlink_diag.ko 2024-03-19T05:46:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/nsh/nsh.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/openvswitch.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-geneve.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-gre.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/openvswitch/vport-vxlan.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/packet/af_packet_diag.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_rdma.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/rds/rds_tcp.ko 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched 2024-03-19T05:46:35.886 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_csum.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_gact.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_mirred.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_nat.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_pedit.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_police.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_simple.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_skbedit.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/act_vlan.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_basic.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_bpf.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_flow.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_fw.ko 2024-03-19T05:46:35.887 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_route.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/cls_u32.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_cmp.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_ipset.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_meta.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_nbyte.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_text.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/em_u32.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_choke.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_codel.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_drr.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_fq.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_gred.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hfsc.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_hhf.ko 2024-03-19T05:46:35.888 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_htb.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_ingress.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_mqprio_lib.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_multiq.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_netem.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_pie.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_plug.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_prio.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_qfq.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_red.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfb.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_sfq.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_tbf.ko 2024-03-19T05:46:35.889 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sched/sch_teql.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sctp/sctp_diag.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/sunrpc.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/diag.ko 2024-03-19T05:46:35.890 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/tipc/tipc.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/unix/unix_diag.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys 2024-03-19T05:46:35.891 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/security/keys/trusted-keys/trusted.ko 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/kernel/virt/lib/irqbypass.ko 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.alias.bin 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.alias.bin 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.bin 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.builtin.modinfo 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.dep.bin 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.devname 2024-03-19T05:46:35.892 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.order 2024-03-19T05:46:35.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.softdep 2024-03-19T05:46:35.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols 2024-03-19T05:46:35.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/modules.symbols.bin 2024-03-19T05:46:35.893 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:46:35.896 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g908b6b276e8f 2024-03-19T05:46:35.897 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout: /usr/bin/kernel-install add 6.8.0-g908b6b276e8f /lib/modules/6.8.0-g908b6b276e8f/vmlinuz 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:for file in vmlinuz System.map config; do 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout: if ! cmp --silent "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f"; then 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout: cp "/lib/modules/6.8.0-g908b6b276e8f/${file}" "/boot/${file}-6.8.0-g908b6b276e8f" 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout: fi 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:done 2024-03-19T05:46:35.921 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:new-kernel-pkg --remove 6.8.0-g908b6b276e8f --rminitrd --initrdfile=/boot/initramfs-6.8.0-g908b6b276e8f.img 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.8.0-g908b6b276e8f 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/update-bootloader --remove 6.8.0-g908b6b276e8f 2024-03-19T05:46:35.922 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-19T05:46:35.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 68.el9 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8264254 2024-03-19T05:46:36.004 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-19T05:46:36.005 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-19T05:46:36.006 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-03-19T05:46:36.006 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:46:36.006 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-03-19T05:46:36.007 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-19T05:46:36.007 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.8.0-g908b6b276e8f 2024-03-19T05:46:36.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-19T05:46:36.587 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-03-19T05:46:38.097 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-19T05:46:38.118 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-03-19T05:46:38.120 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-03-19T05:46:38.176 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.oT5ZGgBF0W 2024-03-19T05:46:38.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oT5ZGgBF0W 2024-03-19T05:46:38.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.oT5ZGgBF0W 2024-03-19T05:46:38.405 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.oT5ZGgBF0W is 6KB 2024-03-19T05:46:38.454 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.oT5ZGgBF0W 2024-03-19T05:46:38.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-03-19T05:46:38.538 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-19T05:46:38.538 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-19T05:46:38.539 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-19T05:46:38.539 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f.conf 2024-03-19T05:46:38.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g908b6b276e8f 2024-03-19T05:46:38.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-03-19T05:46:58.143 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-19T05:46:58.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:46:58.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:47:08.714 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-19T05:47:08.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-19T05:47:08.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:47:32.767 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-03-19T05:47:41.774 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:47:41.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:48:08.743 DEBUG:teuthology.orchestra.remote:timed out 2024-03-19T05:48:17.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-19T05:48:17.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:48:18.175 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-19T05:48:18.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-19T05:48:18.855 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g908b6b276e8f"... 2024-03-19T05:48:18.855 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-19T05:48:18.893 INFO:teuthology.orchestra.run.smithi017.stdout:6.8.0-g908b6b276e8f 2024-03-19T05:48:18.894 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T05:48:18.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T05:48:18.894 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-19T05:48:19.894 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-19T05:48:19.895 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T05:48:20.025 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-03-19T05:48:20.073 DEBUG:teuthology.parallel:result is None 2024-03-19T05:48:41.777 DEBUG:teuthology.orchestra.remote:timed out 2024-03-19T05:48:53.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:48:53.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:48:54.227 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-19T05:48:54.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:48:54.862 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g908b6b276e8f"... 2024-03-19T05:48:54.862 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-03-19T05:48:54.915 INFO:teuthology.orchestra.run.smithi153.stdout:6.8.0-g908b6b276e8f 2024-03-19T05:48:54.915 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g908b6b276e8f vs 6.8.0-g908b6b276e8f 2024-03-19T05:48:54.915 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-19T05:48:54.916 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-19T05:48:55.918 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-19T05:48:55.918 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-19T05:48:56.046 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-03-19T05:48:56.104 DEBUG:teuthology.parallel:result is None 2024-03-19T05:48:56.105 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-19T05:48:56.116 INFO:teuthology.task.internal:Creating test directory... 2024-03-19T05:48:56.116 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T05:48:56.125 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-19T05:48:56.181 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-19T05:48:56.190 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-19T05:48:56.199 INFO:teuthology.task.internal:Creating archive directory... 2024-03-19T05:48:56.200 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T05:48:56.204 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-19T05:48:56.268 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-19T05:48:56.276 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-19T05:48:56.276 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T05:48:56.282 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-19T05:48:56.380 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:48:56.381 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:48:56.420 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:48:56.424 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-19T05:48:56.429 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-19T05:48:56.436 INFO:teuthology.task.internal:Configuring sudo... 2024-03-19T05:48:56.436 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T05:48:56.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-19T05:48:56.536 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-19T05:48:56.546 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-19T05:48:56.546 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T05:48:56.552 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-19T05:48:56.613 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:48:56.696 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:48:56.816 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:48:56.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:48:56.995 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T05:48:56.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T05:48:57.099 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:48:57.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-19T05:48:57.316 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:48:57.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-19T05:48:57.501 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T05:48:57.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-19T05:48:57.588 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-03-19T05:48:57.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-03-19T05:48:57.722 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T05:48:57.750 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T05:48:58.029 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-19T05:48:58.038 INFO:teuthology.task.internal:Starting timer... 2024-03-19T05:48:58.038 INFO:teuthology.run_tasks:Running task pcp... 2024-03-19T05:48:58.126 INFO:teuthology.run_tasks:Running task selinux... 2024-03-19T05:48:58.138 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-19T05:48:58.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-03-19T05:48:58.285 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-03-19T05:48:58.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-03-19T05:48:58.417 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-03-19T05:48:58.421 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-19T05:48:58.421 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-03-19T05:48:58.474 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-03-19T05:48:58.474 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-03-19T05:48:58.547 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-03-19T05:48:58.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-03-19T05:48:58.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T05:48:58.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:48:58.644 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T05:48:58.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T05:48:58.726 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-19T05:48:58.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-03-19T05:48:58.820 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-03-19T05:48:58.919 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-19T05:48:58.931 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-19T05:48:58.947 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-19T05:48:58.948 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-19T05:55:12.050 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-03-19T05:55:12.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-19T05:55:12.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:55:12.202 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-19T05:55:12.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-19T05:55:12.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:55:12.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T05:55:12.509 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-19T05:55:12.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-19T05:55:12.652 INFO:teuthology.run_tasks:Running task clock... 2024-03-19T05:55:12.665 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-19T05:55:12.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T05:55:12.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T05:55:12.673 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-19T05:55:12.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T05:55:12.779 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-19T05:55:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-19T05:55:12.831 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-19T05:55:12.836 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-19T05:55:12.918 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-03-19T05:55:12.932 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-03-19T05:55:12.957 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-03-19T05:55:12.975 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-03-19T05:55:13.010 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-19T05:55:13.030 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-19T05:55:13.064 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-19T05:55:13.085 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-19T05:55:13.191 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-19T05:55:13.200 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T05:55:13.200 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-19T05:55:13.200 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.200 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.200 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.201 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.224 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-19T05:55:13.233 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T05:55:13.233 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-19T05:55:13.233 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.233 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.234 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.234 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T05:55:13.235 INFO:teuthology.run_tasks:Running task install... 2024-03-19T05:55:13.246 DEBUG:teuthology.task.install:project ceph 2024-03-19T05:55:13.246 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}} 2024-03-19T05:55:13.246 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'} 2024-03-19T05:55:13.247 INFO:teuthology.task.install:Using flavor: default 2024-03-19T05:55:13.259 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-03-19T05:55:13.259 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-19T05:55:13.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'tag': None, 'wait_for_package': False} 2024-03-19T05:55:13.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:55:13.264 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'tag': None, 'wait_for_package': False} 2024-03-19T05:55:13.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T05:55:13.406 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/ 2024-03-19T05:55:13.406 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1934.gb0ea271b 2024-03-19T05:55:13.488 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/ 2024-03-19T05:55:13.489 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1934.gb0ea271b 2024-03-19T05:55:13.583 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-19T05:55:13.583 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T05:55:13.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-19T05:55:13.603 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240307.022905/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-19T05:55:13.603 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T05:55:13.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-19T05:55:13.689 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-19T05:55:13.690 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-19T05:55:13.701 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-19T05:55:13.701 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-19T05:55:13.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-19T05:55:13.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-19T05:55:13.966 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-19T05:55:13.977 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-19T05:55:14.051 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-03-19T05:55:14.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-03-19T05:55:14.072 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-03-19T05:55:14.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-03-19T05:55:14.409 INFO:teuthology.orchestra.run.smithi153.stdout:74 files removed 2024-03-19T05:55:14.450 INFO:teuthology.orchestra.run.smithi017.stdout:74 files removed 2024-03-19T05:55:14.452 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-19T05:55:14.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-19T05:55:15.504 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 167 kB/s | 82 kB 00:00 2024-03-19T05:55:15.510 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 149 kB/s | 82 kB 00:00 2024-03-19T05:55:16.011 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-03-19T05:55:16.038 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 23 kB/s | 10 kB 00:00 2024-03-19T05:55:16.539 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-03-19T05:55:16.570 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-03-19T05:55:17.142 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-19T05:55:17.382 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 9.1 MB/s | 6.7 MB 00:00 2024-03-19T05:55:18.860 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-03-19T05:55:19.049 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2024-03-19T05:55:21.039 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.0 MB 00:01 2024-03-19T05:55:23.648 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-03-19T05:55:24.019 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.0 MB 00:04 2024-03-19T05:55:27.338 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 19 MB 00:02 2024-03-19T05:55:29.090 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.1 MB 00:01 2024-03-19T05:55:30.849 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-03-19T05:55:32.821 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.1 MB 00:01 2024-03-19T05:55:34.672 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-19T05:55:48.825 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 21 MB 00:17 2024-03-19T05:55:55.008 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-19T05:55:55.044 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 21 MB 00:20 2024-03-19T05:55:57.667 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-19T05:55:57.668 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-19T05:55:57.712 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-19T05:55:57.713 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-19T05:55:57.714 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-19T05:55:57.716 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-19T05:55:57.718 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-19T05:55:57.721 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-19T05:55:57.722 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-19T05:55:57.817 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout:==================================================================================================== 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout:==================================================================================================== 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-19T05:55:57.855 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 6.6 k 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.4 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 68 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 422 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 889 k 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 6.0 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 145 k 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.4 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 49 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.5 M 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 139 k 2024-03-19T05:55:57.856 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 1.8 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 20 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 7.4 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 49 k 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 99 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 289 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 9.8 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 176 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 47 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 675 M 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 264 k 2024-03-19T05:55:57.857 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 748 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 220 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 27 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 18 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 31 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 746 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.4 M 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 127 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 109 k 2024-03-19T05:55:57.858 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 45 M 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 52 M 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 162 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 615 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 321 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 769 k 2024-03-19T05:55:57.859 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 298 k 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.1 M 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 99 k 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 338 k 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 86 k 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 516 k 2024-03-19T05:55:57.860 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.1 M 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 52 M 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 171 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.3 M 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-19T05:55:57.861 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.4 M 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.1 M 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-19T05:55:57.862 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 20 M 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 23 M 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 34 k 2024-03-19T05:55:57.863 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 2.1 M 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 248 k 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 4.7 M 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 17 M 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 16 k 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 25 k 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-19T05:55:57.864 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 163 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-19T05:55:57.865 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 501 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.1 M 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-19T05:55:57.866 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-19T05:55:57.867 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 45 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 131 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-19T05:55:57.868 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-19T05:55:57.869 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-19T05:55:57.870 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-19T05:55:57.871 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-19T05:55:57.872 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout:Installing weak dependencies: 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout:==================================================================================================== 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout:Install 172 Packages 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 24 Packages 2024-03-19T05:55:57.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T05:55:57.874 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 G 2024-03-19T05:55:57.874 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-19T05:55:58.851 INFO:teuthology.orchestra.run.smithi017.stdout:(1/196): ceph-19.0.0-1934.gb0ea271b.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-03-19T05:55:59.543 INFO:teuthology.orchestra.run.smithi017.stdout:(2/196): ceph-base-19.0.0-1934.gb0ea271b.el9.x8 5.4 MB/s | 5.4 MB 00:00 2024-03-19T05:56:00.813 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-19T05:56:01.235 INFO:teuthology.orchestra.run.smithi017.stdout:(3/196): ceph-common-19.0.0-1934.gb0ea271b.el9. 8.4 MB/s | 20 MB 00:02 2024-03-19T05:56:03.365 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-19T05:56:03.366 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-19T05:56:03.407 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-19T05:56:03.408 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-19T05:56:03.409 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-19T05:56:03.410 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-19T05:56:03.412 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-19T05:56:03.416 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-19T05:56:03.416 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-19T05:56:03.508 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-19T05:56:03.533 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2024-03-19T05:56:03.533 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-19T05:56:03.533 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 6.6 k 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.4 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 68 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 422 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 889 k 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 6.0 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 145 k 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.4 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 49 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.5 M 2024-03-19T05:56:03.534 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 139 k 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 1.8 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 20 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 7.4 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 49 k 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 99 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 289 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 9.8 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 176 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 47 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 675 M 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 264 k 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 748 k 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 220 k 2024-03-19T05:56:03.535 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 27 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 18 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 31 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 746 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.4 M 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 127 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 109 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 45 M 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 52 M 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-19T05:56:03.536 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 162 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 615 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 321 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 769 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 298 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.1 M 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 99 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 338 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 86 k 2024-03-19T05:56:03.537 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 516 k 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.1 M 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 52 M 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 171 k 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 1.3 M 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-19T05:56:03.538 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-19T05:56:03.539 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.4 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 3.1 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-19T05:56:03.540 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 20 M 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-debuginfo x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 23 M 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 34 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 2.1 M 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 248 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 4.7 M 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 17 M 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1934.gb0ea271b.el9 ceph-noarch 16 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 25 k 2024-03-19T05:56:03.541 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-19T05:56:03.542 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 163 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 501 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 5.1 M 2024-03-19T05:56:03.543 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-19T05:56:03.544 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 45 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.0.0-1934.gb0ea271b.el9 ceph 131 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-19T05:56:03.545 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-19T05:56:03.546 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-19T05:56:03.547 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-19T05:56:03.548 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-19T05:56:03.549 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-19T05:56:03.550 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout:==================================================================================================== 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout:Install 172 Packages 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 24 Packages 2024-03-19T05:56:03.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T05:56:03.552 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.2 G 2024-03-19T05:56:03.552 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-19T05:56:04.914 INFO:teuthology.orchestra.run.smithi153.stdout:(1/196): ceph-19.0.0-1934.gb0ea271b.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-03-19T05:56:06.248 INFO:teuthology.orchestra.run.smithi153.stdout:(2/196): ceph-base-19.0.0-1934.gb0ea271b.el9.x8 3.1 MB/s | 5.4 MB 00:01 2024-03-19T05:56:07.798 INFO:teuthology.orchestra.run.smithi153.stdout:(3/196): ceph-common-19.0.0-1934.gb0ea271b.el9. 6.9 MB/s | 20 MB 00:02 2024-03-19T05:56:10.273 INFO:teuthology.orchestra.run.smithi153.stdout:(4/196): ceph-base-debuginfo-19.0.0-1934.gb0ea2 12 MB/s | 68 MB 00:05 2024-03-19T05:56:11.506 INFO:teuthology.orchestra.run.smithi153.stdout:(5/196): ceph-fuse-19.0.0-1934.gb0ea271b.el9.x8 721 kB/s | 889 kB 00:01 2024-03-19T05:56:12.598 INFO:teuthology.orchestra.run.smithi153.stdout:(6/196): ceph-debuginfo-19.0.0-1934.gb0ea271b.e 4.8 MB/s | 23 MB 00:04 2024-03-19T05:56:12.665 INFO:teuthology.orchestra.run.smithi153.stdout:(7/196): ceph-immutable-object-cache-19.0.0-193 2.2 MB/s | 145 kB 00:00 2024-03-19T05:56:12.760 INFO:teuthology.orchestra.run.smithi017.stdout:(4/196): ceph-debuginfo-19.0.0-1934.gb0ea271b.e 2.0 MB/s | 23 MB 00:11 2024-03-19T05:56:12.899 INFO:teuthology.orchestra.run.smithi153.stdout:(8/196): ceph-fuse-debuginfo-19.0.0-1934.gb0ea2 4.3 MB/s | 6.0 MB 00:01 2024-03-19T05:56:12.974 INFO:teuthology.orchestra.run.smithi153.stdout:(9/196): ceph-immutable-object-cache-debuginfo- 4.7 MB/s | 1.4 MB 00:00 2024-03-19T05:56:13.266 INFO:teuthology.orchestra.run.smithi153.stdout:(10/196): ceph-mds-19.0.0-1934.gb0ea271b.el9.x8 5.8 MB/s | 2.1 MB 00:00 2024-03-19T05:56:13.516 INFO:teuthology.orchestra.run.smithi153.stdout:(11/196): ceph-mgr-19.0.0-1934.gb0ea271b.el9.x8 6.0 MB/s | 1.5 MB 00:00 2024-03-19T05:56:13.560 INFO:teuthology.orchestra.run.smithi017.stdout:(5/196): ceph-base-debuginfo-19.0.0-1934.gb0ea2 4.6 MB/s | 68 MB 00:15 2024-03-19T05:56:13.601 INFO:teuthology.orchestra.run.smithi017.stdout:(6/196): ceph-fuse-19.0.0-1934.gb0ea271b.el9.x8 1.0 MB/s | 889 kB 00:00 2024-03-19T05:56:13.735 INFO:teuthology.orchestra.run.smithi017.stdout:(7/196): ceph-immutable-object-cache-19.0.0-193 1.1 MB/s | 145 kB 00:00 2024-03-19T05:56:14.052 INFO:teuthology.orchestra.run.smithi017.stdout:(8/196): ceph-immutable-object-cache-debuginfo- 4.5 MB/s | 1.4 MB 00:00 2024-03-19T05:56:14.458 INFO:teuthology.orchestra.run.smithi017.stdout:(9/196): ceph-mds-19.0.0-1934.gb0ea271b.el9.x86 5.4 MB/s | 2.1 MB 00:00 2024-03-19T05:56:15.461 INFO:teuthology.orchestra.run.smithi017.stdout:(10/196): ceph-fuse-debuginfo-19.0.0-1934.gb0ea 3.1 MB/s | 6.0 MB 00:01 2024-03-19T05:56:15.945 INFO:teuthology.orchestra.run.smithi017.stdout:(11/196): ceph-mgr-19.0.0-1934.gb0ea271b.el9.x8 3.1 MB/s | 1.5 MB 00:00 2024-03-19T05:56:18.717 INFO:teuthology.orchestra.run.smithi153.stdout:(12/196): ceph-mgr-debuginfo-19.0.0-1934.gb0ea2 3.9 MB/s | 20 MB 00:05 2024-03-19T05:56:19.975 INFO:teuthology.orchestra.run.smithi153.stdout:(13/196): ceph-mon-19.0.0-1934.gb0ea271b.el9.x8 3.7 MB/s | 4.7 MB 00:01 2024-03-19T05:56:21.361 INFO:teuthology.orchestra.run.smithi017.stdout:(12/196): ceph-mds-debuginfo-19.0.0-1934.gb0ea2 7.1 MB/s | 49 MB 00:06 2024-03-19T05:56:21.653 INFO:teuthology.orchestra.run.smithi017.stdout:(13/196): ceph-mgr-debuginfo-19.0.0-1934.gb0ea2 3.5 MB/s | 20 MB 00:05 2024-03-19T05:56:21.979 INFO:teuthology.orchestra.run.smithi017.stdout:(14/196): ceph-mon-19.0.0-1934.gb0ea271b.el9.x8 7.6 MB/s | 4.7 MB 00:00 2024-03-19T05:56:27.924 INFO:teuthology.orchestra.run.smithi153.stdout:(14/196): ceph-mds-debuginfo-19.0.0-1934.gb0ea2 3.3 MB/s | 49 MB 00:14 2024-03-19T05:56:29.670 INFO:teuthology.orchestra.run.smithi017.stdout:(15/196): ceph-osd-19.0.0-1934.gb0ea271b.el9.x8 2.2 MB/s | 17 MB 00:07 2024-03-19T05:56:31.449 INFO:teuthology.orchestra.run.smithi153.stdout:(15/196): ceph-osd-19.0.0-1934.gb0ea271b.el9.x8 4.8 MB/s | 17 MB 00:03 2024-03-19T05:56:52.263 INFO:teuthology.orchestra.run.smithi153.stdout:(16/196): ceph-mon-debuginfo-19.0.0-1934.gb0ea2 3.1 MB/s | 99 MB 00:32 2024-03-19T05:56:54.547 INFO:teuthology.orchestra.run.smithi153.stdout:(17/196): ceph-radosgw-19.0.0-1934.gb0ea271b.el 4.3 MB/s | 9.8 MB 00:02 2024-03-19T05:57:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:(16/196): ceph-mon-debuginfo-19.0.0-1934.gb0ea2 2.1 MB/s | 99 MB 00:47 2024-03-19T05:57:11.266 INFO:teuthology.orchestra.run.smithi017.stdout:(17/196): ceph-radosgw-19.0.0-1934.gb0ea271b.el 4.3 MB/s | 9.8 MB 00:02 2024-03-19T05:57:33.076 INFO:teuthology.orchestra.run.smithi153.stdout:(18/196): ceph-osd-debuginfo-19.0.0-1934.gb0ea2 4.7 MB/s | 289 MB 01:01 2024-03-19T05:57:33.133 INFO:teuthology.orchestra.run.smithi153.stdout:(19/196): ceph-selinux-19.0.0-1934.gb0ea271b.el 440 kB/s | 25 kB 00:00 2024-03-19T05:57:33.189 INFO:teuthology.orchestra.run.smithi017.stdout:(18/196): ceph-osd-debuginfo-19.0.0-1934.gb0ea2 4.5 MB/s | 289 MB 01:03 2024-03-19T05:57:33.306 INFO:teuthology.orchestra.run.smithi017.stdout:(19/196): ceph-selinux-19.0.0-1934.gb0ea271b.el 217 kB/s | 25 kB 00:00 2024-03-19T05:57:40.389 INFO:teuthology.orchestra.run.smithi017.stdout:(20/196): ceph-radosgw-debuginfo-19.0.0-1934.gb 6.1 MB/s | 176 MB 00:29 2024-03-19T05:57:42.289 INFO:teuthology.orchestra.run.smithi017.stdout:(21/196): ceph-test-19.0.0-1934.gb0ea271b.el9.x 5.3 MB/s | 47 MB 00:08 2024-03-19T05:57:42.473 INFO:teuthology.orchestra.run.smithi017.stdout:(22/196): cephfs-mirror-19.0.0-1934.gb0ea271b.e 1.2 MB/s | 220 kB 00:00 2024-03-19T05:57:42.640 INFO:teuthology.orchestra.run.smithi017.stdout:(23/196): cephfs-shell-19.0.0-1934.gb0ea271b.el 163 kB/s | 27 kB 00:00 2024-03-19T05:57:42.740 INFO:teuthology.orchestra.run.smithi017.stdout:(24/196): libcephfs-devel-19.0.0-1934.gb0ea271b 315 kB/s | 31 kB 00:00 2024-03-19T05:57:42.957 INFO:teuthology.orchestra.run.smithi017.stdout:(25/196): libcephfs2-19.0.0-1934.gb0ea271b.el9. 3.4 MB/s | 746 kB 00:00 2024-03-19T05:57:43.857 INFO:teuthology.orchestra.run.smithi017.stdout:(26/196): libcephfs2-debuginfo-19.0.0-1934.gb0e 6.0 MB/s | 5.4 MB 00:00 2024-03-19T05:57:43.932 INFO:teuthology.orchestra.run.smithi017.stdout:(27/196): libcephsqlite-19.0.0-1934.gb0ea271b.e 2.2 MB/s | 163 kB 00:00 2024-03-19T05:57:44.007 INFO:teuthology.orchestra.run.smithi153.stdout:(20/196): ceph-test-19.0.0-1934.gb0ea271b.el9.x 4.4 MB/s | 47 MB 00:10 2024-03-19T05:57:44.008 INFO:teuthology.orchestra.run.smithi017.stdout:(28/196): librados-devel-19.0.0-1934.gb0ea271b. 1.7 MB/s | 127 kB 00:00 2024-03-19T05:57:44.125 INFO:teuthology.orchestra.run.smithi017.stdout:(29/196): librados-devel-debuginfo-19.0.0-1934. 938 kB/s | 109 kB 00:00 2024-03-19T05:57:47.674 INFO:teuthology.orchestra.run.smithi153.stdout:(21/196): ceph-radosgw-debuginfo-19.0.0-1934.gb 3.3 MB/s | 176 MB 00:53 2024-03-19T05:57:52.007 INFO:teuthology.orchestra.run.smithi153.stdout:(22/196): cephfs-mirror-19.0.0-1934.gb0ea271b.e 51 kB/s | 220 kB 00:04 2024-03-19T05:57:52.057 INFO:teuthology.orchestra.run.smithi153.stdout:(23/196): cephfs-shell-19.0.0-1934.gb0ea271b.el 553 kB/s | 27 kB 00:00 2024-03-19T05:57:52.107 INFO:teuthology.orchestra.run.smithi153.stdout:(24/196): libcephfs-devel-19.0.0-1934.gb0ea271b 634 kB/s | 31 kB 00:00 2024-03-19T05:57:52.383 INFO:teuthology.orchestra.run.smithi153.stdout:(25/196): libcephfs2-19.0.0-1934.gb0ea271b.el9. 2.7 MB/s | 746 kB 00:00 2024-03-19T05:57:54.075 INFO:teuthology.orchestra.run.smithi153.stdout:(26/196): libcephfs2-debuginfo-19.0.0-1934.gb0e 3.2 MB/s | 5.4 MB 00:01 2024-03-19T05:57:54.158 INFO:teuthology.orchestra.run.smithi153.stdout:(27/196): libcephsqlite-19.0.0-1934.gb0ea271b.e 1.9 MB/s | 163 kB 00:00 2024-03-19T05:57:54.234 INFO:teuthology.orchestra.run.smithi153.stdout:(28/196): librados-devel-19.0.0-1934.gb0ea271b. 1.7 MB/s | 127 kB 00:00 2024-03-19T05:57:54.317 INFO:teuthology.orchestra.run.smithi153.stdout:(29/196): librados-devel-debuginfo-19.0.0-1934. 1.3 MB/s | 109 kB 00:00 2024-03-19T05:57:57.241 INFO:teuthology.orchestra.run.smithi017.stdout:(30/196): librados2-debuginfo-19.0.0-1934.gb0ea 3.4 MB/s | 45 MB 00:13 2024-03-19T05:57:57.666 INFO:teuthology.orchestra.run.smithi017.stdout:(31/196): libradosstriper1-19.0.0-1934.gb0ea271 1.2 MB/s | 501 kB 00:00 2024-03-19T05:58:09.016 INFO:teuthology.orchestra.run.smithi153.stdout:(30/196): librados2-debuginfo-19.0.0-1934.gb0ea 3.1 MB/s | 45 MB 00:14 2024-03-19T05:58:09.624 INFO:teuthology.orchestra.run.smithi153.stdout:(31/196): libradosstriper1-19.0.0-1934.gb0ea271 825 kB/s | 501 kB 00:00 2024-03-19T05:58:11.907 INFO:teuthology.orchestra.run.smithi017.stdout:(32/196): librbd1-debuginfo-19.0.0-1934.gb0ea27 3.7 MB/s | 52 MB 00:14 2024-03-19T05:58:14.315 INFO:teuthology.orchestra.run.smithi017.stdout:(33/196): ceph-common-debuginfo-19.0.0-1934.gb0 3.1 MB/s | 422 MB 02:14 2024-03-19T05:58:14.590 INFO:teuthology.orchestra.run.smithi017.stdout:(34/196): python3-ceph-argparse-19.0.0-1934.gb0 165 kB/s | 45 kB 00:00 2024-03-19T05:58:14.782 INFO:teuthology.orchestra.run.smithi017.stdout:(35/196): python3-ceph-common-19.0.0-1934.gb0ea 689 kB/s | 131 kB 00:00 2024-03-19T05:58:14.907 INFO:teuthology.orchestra.run.smithi017.stdout:(36/196): librgw2-19.0.0-1934.gb0ea271b.el9.x86 1.7 MB/s | 5.1 MB 00:02 2024-03-19T05:58:14.999 INFO:teuthology.orchestra.run.smithi017.stdout:(37/196): python3-cephfs-19.0.0-1934.gb0ea271b. 749 kB/s | 162 kB 00:00 2024-03-19T05:58:15.249 INFO:teuthology.orchestra.run.smithi017.stdout:(38/196): python3-rados-19.0.0-1934.gb0ea271b.e 1.3 MB/s | 321 kB 00:00 2024-03-19T05:58:15.366 INFO:teuthology.orchestra.run.smithi017.stdout:(39/196): python3-cephfs-debuginfo-19.0.0-1934. 1.3 MB/s | 615 kB 00:00 2024-03-19T05:58:15.667 INFO:teuthology.orchestra.run.smithi017.stdout:(40/196): python3-rados-debuginfo-19.0.0-1934.g 1.8 MB/s | 769 kB 00:00 2024-03-19T05:58:15.700 INFO:teuthology.orchestra.run.smithi017.stdout:(41/196): python3-rbd-19.0.0-1934.gb0ea271b.el9 897 kB/s | 298 kB 00:00 2024-03-19T05:58:16.359 INFO:teuthology.orchestra.run.smithi017.stdout:(42/196): python3-rgw-19.0.0-1934.gb0ea271b.el9 703 kB/s | 99 kB 00:00 2024-03-19T05:58:16.360 INFO:teuthology.orchestra.run.smithi017.stdout:(43/196): python3-rgw-debuginfo-19.0.0-1934.gb0 1.1 MB/s | 338 kB 00:00 2024-03-19T05:58:16.360 INFO:teuthology.orchestra.run.smithi017.stdout:(44/196): python3-rbd-debuginfo-19.0.0-1934.gb0 2.1 MB/s | 1.1 MB 00:00 2024-03-19T05:58:16.360 INFO:teuthology.orchestra.run.smithi017.stdout:(45/196): rbd-fuse-19.0.0-1934.gb0ea271b.el9.x8 859 kB/s | 86 kB 00:00 2024-03-19T05:58:16.443 INFO:teuthology.orchestra.run.smithi017.stdout:(46/196): rbd-fuse-debuginfo-19.0.0-1934.gb0ea2 2.1 MB/s | 516 kB 00:00 2024-03-19T05:58:17.835 INFO:teuthology.orchestra.run.smithi017.stdout:(47/196): rbd-mirror-19.0.0-1934.gb0ea271b.el9. 1.9 MB/s | 3.1 MB 00:01 2024-03-19T05:58:18.027 INFO:teuthology.orchestra.run.smithi017.stdout:(48/196): rbd-nbd-19.0.0-1934.gb0ea271b.el9.x86 897 kB/s | 171 kB 00:00 2024-03-19T05:58:18.760 INFO:teuthology.orchestra.run.smithi017.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-1934.gb0ea27 1.7 MB/s | 1.3 MB 00:00 2024-03-19T05:58:18.869 INFO:teuthology.orchestra.run.smithi017.stdout:(50/196): ceph-grafana-dashboards-19.0.0-1934.g 316 kB/s | 34 kB 00:00 2024-03-19T05:58:18.978 INFO:teuthology.orchestra.run.smithi017.stdout:(51/196): ceph-mgr-cephadm-19.0.0-1934.gb0ea271 1.3 MB/s | 139 kB 00:00 2024-03-19T05:58:19.894 INFO:teuthology.orchestra.run.smithi017.stdout:(52/196): ceph-mgr-dashboard-19.0.0-1934.gb0ea2 2.0 MB/s | 1.8 MB 00:00 2024-03-19T05:58:22.931 INFO:teuthology.orchestra.run.smithi153.stdout:(32/196): ceph-common-debuginfo-19.0.0-1934.gb0 3.1 MB/s | 422 MB 02:16 2024-03-19T05:58:23.661 INFO:teuthology.orchestra.run.smithi017.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-03-19T05:58:23.836 INFO:teuthology.orchestra.run.smithi017.stdout:(54/196): ceph-mgr-modules-core-19.0.0-1934.gb0 1.4 MB/s | 248 kB 00:00 2024-03-19T05:58:23.920 INFO:teuthology.orchestra.run.smithi017.stdout:(55/196): ceph-mgr-rook-19.0.0-1934.gb0ea271b.e 595 kB/s | 49 kB 00:00 2024-03-19T05:58:23.987 INFO:teuthology.orchestra.run.smithi017.stdout:(56/196): ceph-prometheus-alerts-19.0.0-1934.gb 250 kB/s | 16 kB 00:00 2024-03-19T05:58:24.179 INFO:teuthology.orchestra.run.smithi017.stdout:(57/196): ceph-volume-19.0.0-1934.gb0ea271b.el9 1.3 MB/s | 264 kB 00:00 2024-03-19T05:58:24.629 INFO:teuthology.orchestra.run.smithi017.stdout:(58/196): cephadm-19.0.0-1934.gb0ea271b.el9.noa 1.6 MB/s | 748 kB 00:00 2024-03-19T05:58:24.704 INFO:teuthology.orchestra.run.smithi017.stdout:(59/196): cephfs-top-19.0.0-1934.gb0ea271b.el9. 246 kB/s | 18 kB 00:00 2024-03-19T05:58:24.913 INFO:teuthology.orchestra.run.smithi017.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 662 kB 00:00 2024-03-19T05:58:24.980 INFO:teuthology.orchestra.run.smithi017.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2024-03-19T05:58:25.014 INFO:teuthology.orchestra.run.smithi017.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2024-03-19T05:58:25.055 INFO:teuthology.orchestra.run.smithi017.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 307 kB 00:00 2024-03-19T05:58:25.089 INFO:teuthology.orchestra.run.smithi017.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 977 kB/s | 32 kB 00:00 2024-03-19T05:58:25.198 INFO:teuthology.orchestra.run.smithi017.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-19T05:58:25.231 INFO:teuthology.orchestra.run.smithi017.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 530 kB/s | 17 kB 00:00 2024-03-19T05:58:25.265 INFO:teuthology.orchestra.run.smithi017.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 309 kB/s | 10 kB 00:00 2024-03-19T05:58:25.307 INFO:teuthology.orchestra.run.smithi017.stdout:(68/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-03-19T05:58:25.340 INFO:teuthology.orchestra.run.smithi017.stdout:(69/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-19T05:58:25.399 INFO:teuthology.orchestra.run.smithi017.stdout:(70/196): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-19T05:58:25.458 INFO:teuthology.orchestra.run.smithi017.stdout:(71/196): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2024-03-19T05:58:25.491 INFO:teuthology.orchestra.run.smithi017.stdout:(72/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-19T05:58:25.533 INFO:teuthology.orchestra.run.smithi017.stdout:(73/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2024-03-19T05:58:25.564 INFO:teuthology.orchestra.run.smithi153.stdout:(33/196): librgw2-19.0.0-1934.gb0ea271b.el9.x86 1.9 MB/s | 5.1 MB 00:02 2024-03-19T05:58:25.575 INFO:teuthology.orchestra.run.smithi017.stdout:(74/196): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-03-19T05:58:25.617 INFO:teuthology.orchestra.run.smithi017.stdout:(75/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-03-19T05:58:25.648 INFO:teuthology.orchestra.run.smithi153.stdout:(34/196): python3-ceph-argparse-19.0.0-1934.gb0 549 kB/s | 45 kB 00:00 2024-03-19T05:58:25.651 INFO:teuthology.orchestra.run.smithi017.stdout:(76/196): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-19T05:58:25.790 INFO:teuthology.orchestra.run.smithi153.stdout:(35/196): python3-ceph-common-19.0.0-1934.gb0ea 931 kB/s | 131 kB 00:00 2024-03-19T05:58:25.792 INFO:teuthology.orchestra.run.smithi017.stdout:(77/196): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2024-03-19T05:58:25.868 INFO:teuthology.orchestra.run.smithi017.stdout:(78/196): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2024-03-19T05:58:25.907 INFO:teuthology.orchestra.run.smithi153.stdout:(36/196): python3-cephfs-19.0.0-1934.gb0ea271b. 1.4 MB/s | 162 kB 00:00 2024-03-19T05:58:25.935 INFO:teuthology.orchestra.run.smithi017.stdout:(79/196): postgresql-contrib-13.11-1.el9.x86_64 12 MB/s | 811 kB 00:00 2024-03-19T05:58:25.977 INFO:teuthology.orchestra.run.smithi017.stdout:(80/196): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2024-03-19T05:58:26.127 INFO:teuthology.orchestra.run.smithi017.stdout:(81/196): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-03-19T05:58:26.182 INFO:teuthology.orchestra.run.smithi153.stdout:(37/196): python3-cephfs-debuginfo-19.0.0-1934. 2.2 MB/s | 615 kB 00:00 2024-03-19T05:58:26.186 INFO:teuthology.orchestra.run.smithi017.stdout:(82/196): protobuf-3.14.0-13.el9.x86_64.rpm 18 MB/s | 1.0 MB 00:00 2024-03-19T05:58:26.222 INFO:teuthology.orchestra.run.smithi017.stdout:(83/196): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-03-19T05:58:26.390 INFO:teuthology.orchestra.run.smithi017.stdout:(84/196): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 5.8 MB 00:00 2024-03-19T05:58:26.391 INFO:teuthology.orchestra.run.smithi153.stdout:(38/196): python3-rados-19.0.0-1934.gb0ea271b.e 1.5 MB/s | 321 kB 00:00 2024-03-19T05:58:26.429 INFO:teuthology.orchestra.run.smithi017.stdout:(85/196): python3-jsonpatch-1.21-16.el9.noarch. 649 kB/s | 24 kB 00:00 2024-03-19T05:58:26.462 INFO:teuthology.orchestra.run.smithi017.stdout:(86/196): python3-jsonpointer-2.0-4.el9.noarch. 559 kB/s | 18 kB 00:00 2024-03-19T05:58:26.504 INFO:teuthology.orchestra.run.smithi017.stdout:(87/196): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-03-19T05:58:26.538 INFO:teuthology.orchestra.run.smithi017.stdout:(88/196): python3-markupsafe-1.1.1-12.el9.x86_6 966 kB/s | 32 kB 00:00 2024-03-19T05:58:26.697 INFO:teuthology.orchestra.run.smithi017.stdout:(89/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2024-03-19T05:58:26.738 INFO:teuthology.orchestra.run.smithi017.stdout:(90/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.2 MB/s | 217 kB 00:00 2024-03-19T05:58:26.741 INFO:teuthology.orchestra.run.smithi153.stdout:(39/196): python3-rados-debuginfo-19.0.0-1934.g 2.2 MB/s | 769 kB 00:00 2024-03-19T05:58:26.781 INFO:teuthology.orchestra.run.smithi017.stdout:(91/196): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-19T05:58:26.814 INFO:teuthology.orchestra.run.smithi017.stdout:(92/196): python3-packaging-20.9-5.el9.noarch.r 2.1 MB/s | 69 kB 00:00 2024-03-19T05:58:26.848 INFO:teuthology.orchestra.run.smithi017.stdout:(93/196): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-03-19T05:58:26.890 INFO:teuthology.orchestra.run.smithi017.stdout:(94/196): python3-protobuf-3.14.0-13.el9.noarch 5.7 MB/s | 238 kB 00:00 2024-03-19T05:58:26.916 INFO:teuthology.orchestra.run.smithi153.stdout:(40/196): python3-rbd-19.0.0-1934.gb0ea271b.el9 1.7 MB/s | 298 kB 00:00 2024-03-19T05:58:26.932 INFO:teuthology.orchestra.run.smithi017.stdout:(95/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-03-19T05:58:26.974 INFO:teuthology.orchestra.run.smithi017.stdout:(96/196): python3-pyasn1-modules-0.4.8-6.el9.no 5.1 MB/s | 211 kB 00:00 2024-03-19T05:58:27.007 INFO:teuthology.orchestra.run.smithi017.stdout:(97/196): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-19T05:58:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:(98/196): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-03-19T05:58:27.391 INFO:teuthology.orchestra.run.smithi017.stdout:(99/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-03-19T05:58:27.425 INFO:teuthology.orchestra.run.smithi017.stdout:(100/196): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 39 kB 00:00 2024-03-19T05:58:27.458 INFO:teuthology.orchestra.run.smithi017.stdout:(101/196): python3-wcwidth-0.2.5-8.el9.noarch.r 1.2 MB/s | 41 kB 00:00 2024-03-19T05:58:27.500 INFO:teuthology.orchestra.run.smithi017.stdout:(102/196): socat-1.7.4.1-5.el9.x86_64.rpm 7.2 MB/s | 300 kB 00:00 2024-03-19T05:58:27.534 INFO:teuthology.orchestra.run.smithi017.stdout:(103/196): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-03-19T05:58:27.568 INFO:teuthology.orchestra.run.smithi017.stdout:(104/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-03-19T05:58:27.601 INFO:teuthology.orchestra.run.smithi017.stdout:(105/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-19T05:58:27.635 INFO:teuthology.orchestra.run.smithi017.stdout:(106/196): fuse-2.9.9-15.el9.x86_64.rpm 2.4 MB/s | 79 kB 00:00 2024-03-19T05:58:27.650 INFO:teuthology.orchestra.run.smithi153.stdout:(41/196): librbd1-debuginfo-19.0.0-1934.gb0ea27 2.9 MB/s | 52 MB 00:18 2024-03-19T05:58:27.677 INFO:teuthology.orchestra.run.smithi017.stdout:(107/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.8 MB/s | 241 kB 00:00 2024-03-19T05:58:27.709 INFO:teuthology.orchestra.run.smithi153.stdout:(42/196): python3-rbd-debuginfo-19.0.0-1934.gb0 1.4 MB/s | 1.1 MB 00:00 2024-03-19T05:58:27.742 INFO:teuthology.orchestra.run.smithi153.stdout:(43/196): python3-rgw-19.0.0-1934.gb0ea271b.el9 1.1 MB/s | 99 kB 00:00 2024-03-19T05:58:27.744 INFO:teuthology.orchestra.run.smithi017.stdout:(108/196): python3-cryptography-36.0.1-4.el9.x8 17 MB/s | 1.1 MB 00:00 2024-03-19T05:58:27.778 INFO:teuthology.orchestra.run.smithi017.stdout:(109/196): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 103 kB 00:00 2024-03-19T05:58:27.809 INFO:teuthology.orchestra.run.smithi153.stdout:(44/196): rbd-fuse-19.0.0-1934.gb0ea271b.el9.x8 1.3 MB/s | 86 kB 00:00 2024-03-19T05:58:27.811 INFO:teuthology.orchestra.run.smithi017.stdout:(110/196): python3-pycparser-2.20-6.el9.noarch. 3.7 MB/s | 124 kB 00:00 2024-03-19T05:58:27.853 INFO:teuthology.orchestra.run.smithi017.stdout:(111/196): python3-urllib3-1.26.5-5.el9.noarch. 4.5 MB/s | 187 kB 00:00 2024-03-19T05:58:27.884 INFO:teuthology.orchestra.run.smithi153.stdout:(45/196): python3-rgw-debuginfo-19.0.0-1934.gb0 1.9 MB/s | 338 kB 00:00 2024-03-19T05:58:27.943 INFO:teuthology.orchestra.run.smithi153.stdout:(46/196): rbd-fuse-debuginfo-19.0.0-1934.gb0ea2 3.8 MB/s | 516 kB 00:00 2024-03-19T05:58:27.987 INFO:teuthology.orchestra.run.smithi017.stdout:(112/196): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-03-19T05:58:28.080 INFO:teuthology.orchestra.run.smithi017.stdout:(113/196): libgfortran-11.4.1-3.el9.x86_64.rpm 8.6 MB/s | 803 kB 00:00 2024-03-19T05:58:28.129 INFO:teuthology.orchestra.run.smithi017.stdout:(114/196): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-03-19T05:58:28.179 INFO:teuthology.orchestra.run.smithi017.stdout:(115/196): python3-requests-2.25.1-8.el9.noarch 2.5 MB/s | 125 kB 00:00 2024-03-19T05:58:28.222 INFO:teuthology.orchestra.run.smithi017.stdout:(116/196): elfutils-libelf-devel-0.190-2.el9.x8 524 kB/s | 21 kB 00:00 2024-03-19T05:58:28.263 INFO:teuthology.orchestra.run.smithi017.stdout:(117/196): libuuid-devel-2.37.4-18.el9.x86_64.r 624 kB/s | 25 kB 00:00 2024-03-19T05:58:28.439 INFO:teuthology.orchestra.run.smithi017.stdout:(118/196): openssl-devel-3.0.7-27.el9.x86_64.rp 24 MB/s | 4.1 MB 00:00 2024-03-19T05:58:28.489 INFO:teuthology.orchestra.run.smithi017.stdout:(119/196): python3-devel-3.9.17-2.el9.x86_64.rp 4.9 MB/s | 245 kB 00:00 2024-03-19T05:58:28.539 INFO:teuthology.orchestra.run.smithi017.stdout:(120/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.9 MB/s | 248 kB 00:00 2024-03-19T05:58:28.590 INFO:teuthology.orchestra.run.smithi017.stdout:(121/196): qatlib-23.11.0-1.el9.x86_64.rpm 4.3 MB/s | 216 kB 00:00 2024-03-19T05:58:28.632 INFO:teuthology.orchestra.run.smithi017.stdout:(122/196): qatlib-service-23.11.0-1.el9.x86_64. 851 kB/s | 35 kB 00:00 2024-03-19T05:58:28.674 INFO:teuthology.orchestra.run.smithi017.stdout:(123/196): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-19T05:58:28.732 INFO:teuthology.orchestra.run.smithi017.stdout:(124/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-19T05:58:28.774 INFO:teuthology.orchestra.run.smithi017.stdout:(125/196): lua-devel-5.4.4-4.el9.x86_64.rpm 546 kB/s | 22 kB 00:00 2024-03-19T05:58:28.840 INFO:teuthology.orchestra.run.smithi017.stdout:(126/196): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-03-19T05:58:29.002 INFO:teuthology.orchestra.run.smithi153.stdout:(47/196): rbd-mirror-19.0.0-1934.gb0ea271b.el9. 2.8 MB/s | 3.1 MB 00:01 2024-03-19T05:58:29.177 INFO:teuthology.orchestra.run.smithi153.stdout:(48/196): rbd-nbd-19.0.0-1934.gb0ea271b.el9.x86 983 kB/s | 171 kB 00:00 2024-03-19T05:58:29.391 INFO:teuthology.orchestra.run.smithi017.stdout:(127/196): abseil-cpp-20211102.0-3.el9.x86_64.r 998 kB/s | 548 kB 00:00 2024-03-19T05:58:29.541 INFO:teuthology.orchestra.run.smithi017.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 2.0 MB/s | 309 kB 00:00 2024-03-19T05:58:29.686 INFO:teuthology.orchestra.run.smithi153.stdout:(49/196): rbd-nbd-debuginfo-19.0.0-1934.gb0ea27 2.5 MB/s | 1.3 MB 00:00 2024-03-19T05:58:29.761 INFO:teuthology.orchestra.run.smithi153.stdout:(50/196): ceph-grafana-dashboards-19.0.0-1934.g 459 kB/s | 34 kB 00:00 2024-03-19T05:58:29.800 INFO:teuthology.orchestra.run.smithi017.stdout:(129/196): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-03-19T05:58:29.861 INFO:teuthology.orchestra.run.smithi153.stdout:(51/196): ceph-mgr-cephadm-19.0.0-1934.gb0ea271 1.4 MB/s | 139 kB 00:00 2024-03-19T05:58:30.653 INFO:teuthology.orchestra.run.smithi153.stdout:(52/196): ceph-mgr-dashboard-19.0.0-1934.gb0ea2 2.3 MB/s | 1.8 MB 00:00 2024-03-19T05:58:31.859 INFO:teuthology.orchestra.run.smithi017.stdout:(130/196): libarrow-9.0.0-10.el9.x86_64.rpm 2.1 MB/s | 4.4 MB 00:02 2024-03-19T05:58:33.131 INFO:teuthology.orchestra.run.smithi017.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 20 kB/s | 26 kB 00:01 2024-03-19T05:58:33.586 INFO:teuthology.orchestra.run.smithi153.stdout:(53/196): ceph-mgr-diskprediction-local-19.0.0- 2.5 MB/s | 7.4 MB 00:02 2024-03-19T05:58:33.928 INFO:teuthology.orchestra.run.smithi153.stdout:(54/196): ceph-mgr-modules-core-19.0.0-1934.gb0 728 kB/s | 248 kB 00:00 2024-03-19T05:58:34.046 INFO:teuthology.orchestra.run.smithi153.stdout:(55/196): ceph-mgr-rook-19.0.0-1934.gb0ea271b.e 424 kB/s | 49 kB 00:00 2024-03-19T05:58:34.067 INFO:teuthology.orchestra.run.smithi017.stdout:(132/196): rbd-mirror-debuginfo-19.0.0-1934.gb0 2.9 MB/s | 52 MB 00:17 2024-03-19T05:58:34.101 INFO:teuthology.orchestra.run.smithi017.stdout:(133/196): liboath-2.6.7-2.el9.x86_64.rpm 50 kB/s | 49 kB 00:00 2024-03-19T05:58:34.137 INFO:teuthology.orchestra.run.smithi153.stdout:(56/196): ceph-prometheus-alerts-19.0.0-1934.gb 183 kB/s | 16 kB 00:00 2024-03-19T05:58:34.321 INFO:teuthology.orchestra.run.smithi153.stdout:(57/196): ceph-volume-19.0.0-1934.gb0ea271b.el9 1.4 MB/s | 264 kB 00:00 2024-03-19T05:58:34.618 INFO:teuthology.orchestra.run.smithi017.stdout:(134/196): libunwind-1.6.2-1.el9.x86_64.rpm 123 kB/s | 67 kB 00:00 2024-03-19T05:58:34.668 INFO:teuthology.orchestra.run.smithi017.stdout:(135/196): luarocks-3.9.2-1.el9.noarch.rpm 267 kB/s | 151 kB 00:00 2024-03-19T05:58:34.713 INFO:teuthology.orchestra.run.smithi153.stdout:(58/196): cephadm-19.0.0-1934.gb0ea271b.el9.noa 1.9 MB/s | 748 kB 00:00 2024-03-19T05:58:34.821 INFO:teuthology.orchestra.run.smithi153.stdout:(59/196): cephfs-top-19.0.0-1934.gb0ea271b.el9. 170 kB/s | 18 kB 00:00 2024-03-19T05:58:34.935 INFO:teuthology.orchestra.run.smithi017.stdout:(136/196): python3-asyncssh-2.13.2-4.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-03-19T05:58:35.013 INFO:teuthology.orchestra.run.smithi153.stdout:(60/196): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-03-19T05:58:35.105 INFO:teuthology.orchestra.run.smithi153.stdout:(61/196): bison-3.7.4-5.el9.x86_64.rpm 9.9 MB/s | 920 kB 00:00 2024-03-19T05:58:35.147 INFO:teuthology.orchestra.run.smithi153.stdout:(62/196): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-19T05:58:35.198 INFO:teuthology.orchestra.run.smithi153.stdout:(63/196): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-03-19T05:58:35.240 INFO:teuthology.orchestra.run.smithi153.stdout:(64/196): flexiblas-3.0.4-8.el9.x86_64.rpm 778 kB/s | 32 kB 00:00 2024-03-19T05:58:35.357 INFO:teuthology.orchestra.run.smithi153.stdout:(65/196): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-19T05:58:35.407 INFO:teuthology.orchestra.run.smithi153.stdout:(66/196): flexiblas-openblas-openmp-3.0.4-8.el9 350 kB/s | 17 kB 00:00 2024-03-19T05:58:35.440 INFO:teuthology.orchestra.run.smithi153.stdout:(67/196): libaio-devel-0.3.111-13.el9.x86_64.rp 311 kB/s | 10 kB 00:00 2024-03-19T05:58:35.482 INFO:teuthology.orchestra.run.smithi153.stdout:(68/196): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-03-19T05:58:35.516 INFO:teuthology.orchestra.run.smithi153.stdout:(69/196): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-19T05:58:35.575 INFO:teuthology.orchestra.run.smithi153.stdout:(70/196): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-19T05:58:35.625 INFO:teuthology.orchestra.run.smithi153.stdout:(71/196): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-19T05:58:35.659 INFO:teuthology.orchestra.run.smithi153.stdout:(72/196): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-19T05:58:35.701 INFO:teuthology.orchestra.run.smithi153.stdout:(73/196): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2024-03-19T05:58:35.742 INFO:teuthology.orchestra.run.smithi153.stdout:(74/196): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2024-03-19T05:58:35.793 INFO:teuthology.orchestra.run.smithi153.stdout:(75/196): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-19T05:58:35.818 INFO:teuthology.orchestra.run.smithi153.stdout:(76/196): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-03-19T05:58:35.877 INFO:teuthology.orchestra.run.smithi017.stdout:(137/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 46 kB/s | 43 kB 00:00 2024-03-19T05:58:35.994 INFO:teuthology.orchestra.run.smithi153.stdout:(77/196): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-19T05:58:36.078 INFO:teuthology.orchestra.run.smithi153.stdout:(78/196): postgresql-13.11-1.el9.x86_64.rpm 18 MB/s | 1.5 MB 00:00 2024-03-19T05:58:36.578 INFO:teuthology.orchestra.run.smithi153.stdout:(79/196): rbd-mirror-debuginfo-19.0.0-1934.gb0e 6.0 MB/s | 52 MB 00:08 2024-03-19T05:58:36.628 INFO:teuthology.orchestra.run.smithi153.stdout:(80/196): postgresql-contrib-13.11-1.el9.x86_64 1.4 MB/s | 811 kB 00:00 2024-03-19T05:58:36.654 INFO:teuthology.orchestra.run.smithi153.stdout:(81/196): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2024-03-19T05:58:36.820 INFO:teuthology.orchestra.run.smithi153.stdout:(82/196): postgresql-server-13.11-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2024-03-19T05:58:36.871 INFO:teuthology.orchestra.run.smithi153.stdout:(83/196): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-03-19T05:58:36.896 INFO:teuthology.orchestra.run.smithi153.stdout:(84/196): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-19T05:58:37.080 INFO:teuthology.orchestra.run.smithi153.stdout:(85/196): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-19T05:58:37.105 INFO:teuthology.orchestra.run.smithi153.stdout:(86/196): python3-jsonpatch-1.21-16.el9.noarch. 125 kB/s | 24 kB 00:00 2024-03-19T05:58:37.144 INFO:teuthology.orchestra.run.smithi017.stdout:(138/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 332 kB/s | 838 kB 00:02 2024-03-19T05:58:37.147 INFO:teuthology.orchestra.run.smithi153.stdout:(87/196): python3-jsonpointer-2.0-4.el9.noarch. 448 kB/s | 18 kB 00:00 2024-03-19T05:58:37.172 INFO:teuthology.orchestra.run.smithi153.stdout:(88/196): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 144 kB 00:00 2024-03-19T05:58:37.197 INFO:teuthology.orchestra.run.smithi153.stdout:(89/196): python3-markupsafe-1.1.1-12.el9.x86_6 655 kB/s | 32 kB 00:00 2024-03-19T05:58:37.356 INFO:teuthology.orchestra.run.smithi153.stdout:(90/196): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-19T05:58:37.381 INFO:teuthology.orchestra.run.smithi153.stdout:(91/196): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-19T05:58:37.407 INFO:teuthology.orchestra.run.smithi153.stdout:(92/196): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 174 kB 00:00 2024-03-19T05:58:37.432 INFO:teuthology.orchestra.run.smithi153.stdout:(93/196): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-03-19T05:58:37.457 INFO:teuthology.orchestra.run.smithi153.stdout:(94/196): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 41 kB 00:00 2024-03-19T05:58:37.491 INFO:teuthology.orchestra.run.smithi153.stdout:(95/196): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-03-19T05:58:37.516 INFO:teuthology.orchestra.run.smithi153.stdout:(96/196): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-19T05:58:37.550 INFO:teuthology.orchestra.run.smithi153.stdout:(97/196): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2024-03-19T05:58:37.577 INFO:teuthology.orchestra.run.smithi153.stdout:(98/196): python3-pytz-2021.1-5.el9.noarch.rpm 846 kB/s | 47 kB 00:00 2024-03-19T05:58:37.601 INFO:teuthology.orchestra.run.smithi153.stdout:(99/196): python3-requests-oauthlib-1.3.0-12.el 875 kB/s | 43 kB 00:00 2024-03-19T05:58:37.834 INFO:teuthology.orchestra.run.smithi153.stdout:(100/196): python3-toml-0.10.2-6.el9.noarch.rpm 172 kB/s | 39 kB 00:00 2024-03-19T05:58:38.077 INFO:teuthology.orchestra.run.smithi017.stdout:(139/196): python3-certifi-2021.10.8-2.el9.noar 16 kB/s | 15 kB 00:00 2024-03-19T05:58:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:(140/196): python3-cachetools-4.2.4-1.el9.noarc 14 kB/s | 32 kB 00:02 2024-03-19T05:58:38.318 INFO:teuthology.orchestra.run.smithi153.stdout:(101/196): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-19T05:58:38.351 INFO:teuthology.orchestra.run.smithi153.stdout:(102/196): python3-wcwidth-0.2.5-8.el9.noarch.r 80 kB/s | 41 kB 00:00 2024-03-19T05:58:38.393 INFO:teuthology.orchestra.run.smithi153.stdout:(103/196): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2024-03-19T05:58:38.427 INFO:teuthology.orchestra.run.smithi153.stdout:(104/196): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2024-03-19T05:58:38.452 INFO:teuthology.orchestra.run.smithi153.stdout:(105/196): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-19T05:58:38.477 INFO:teuthology.orchestra.run.smithi153.stdout:(106/196): zlib-devel-1.2.11-40.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2024-03-19T05:58:38.503 INFO:teuthology.orchestra.run.smithi153.stdout:(107/196): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2024-03-19T05:58:38.537 INFO:teuthology.orchestra.run.smithi153.stdout:(108/196): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-19T05:58:38.595 INFO:teuthology.orchestra.run.smithi153.stdout:(109/196): python3-cryptography-36.0.1-4.el9.x8 13 MB/s | 1.1 MB 00:00 2024-03-19T05:58:38.620 INFO:teuthology.orchestra.run.smithi153.stdout:(110/196): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-19T05:58:38.646 INFO:teuthology.orchestra.run.smithi153.stdout:(111/196): python3-pycparser-2.20-6.el9.noarch. 2.5 MB/s | 124 kB 00:00 2024-03-19T05:58:38.679 INFO:teuthology.orchestra.run.smithi153.stdout:(112/196): python3-urllib3-1.26.5-5.el9.noarch. 3.2 MB/s | 187 kB 00:00 2024-03-19T05:58:39.187 INFO:teuthology.orchestra.run.smithi153.stdout:(113/196): jq-1.6-16.el9.x86_64.rpm 348 kB/s | 187 kB 00:00 2024-03-19T05:58:39.379 INFO:teuthology.orchestra.run.smithi153.stdout:(114/196): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-03-19T05:58:39.424 INFO:teuthology.orchestra.run.smithi153.stdout:(115/196): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-19T05:58:39.496 INFO:teuthology.orchestra.run.smithi153.stdout:(116/196): python3-requests-2.25.1-8.el9.noarch 1.0 MB/s | 125 kB 00:00 2024-03-19T05:58:39.513 INFO:teuthology.orchestra.run.smithi153.stdout:(117/196): elfutils-libelf-devel-0.190-2.el9.x8 234 kB/s | 21 kB 00:00 2024-03-19T05:58:39.547 INFO:teuthology.orchestra.run.smithi153.stdout:(118/196): libuuid-devel-2.37.4-18.el9.x86_64.r 509 kB/s | 25 kB 00:00 2024-03-19T05:58:39.631 INFO:teuthology.orchestra.run.smithi153.stdout:(119/196): python3-devel-3.9.17-2.el9.x86_64.rp 2.9 MB/s | 245 kB 00:00 2024-03-19T05:58:39.689 INFO:teuthology.orchestra.run.smithi153.stdout:(120/196): python3-jinja2-2.11.3-5.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-03-19T05:58:39.757 INFO:teuthology.orchestra.run.smithi153.stdout:(121/196): qatlib-23.11.0-1.el9.x86_64.rpm 3.7 MB/s | 216 kB 00:00 2024-03-19T05:58:39.781 INFO:teuthology.orchestra.run.smithi153.stdout:(122/196): qatlib-service-23.11.0-1.el9.x86_64. 1.0 MB/s | 35 kB 00:00 2024-03-19T05:58:39.904 INFO:teuthology.orchestra.run.smithi153.stdout:(123/196): openssl-devel-3.0.7-27.el9.x86_64.rp 11 MB/s | 4.1 MB 00:00 2024-03-19T05:58:39.911 INFO:teuthology.orchestra.run.smithi017.stdout:(141/196): python3-cherrypy-18.6.1-2.el9.noarch 198 kB/s | 358 kB 00:01 2024-03-19T05:58:39.915 INFO:teuthology.orchestra.run.smithi153.stdout:(124/196): qatzip-libs-1.1.2-2.el9.x86_64.rpm 335 kB/s | 44 kB 00:00 2024-03-19T05:58:39.940 INFO:teuthology.orchestra.run.smithi153.stdout:(125/196): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 2.2 MB/s | 94 kB 00:00 2024-03-19T05:58:40.066 INFO:teuthology.orchestra.run.smithi153.stdout:(126/196): lua-devel-5.4.4-4.el9.x86_64.rpm 149 kB/s | 22 kB 00:00 2024-03-19T05:58:40.328 INFO:teuthology.orchestra.run.smithi017.stdout:(142/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 729 kB/s | 303 kB 00:00 2024-03-19T05:58:40.341 INFO:teuthology.orchestra.run.smithi153.stdout:(127/196): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-03-19T05:58:40.370 INFO:teuthology.orchestra.run.smithi017.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 867 kB/s | 35 kB 00:00 2024-03-19T05:58:40.562 INFO:teuthology.orchestra.run.smithi017.stdout:(144/196): python3-google-auth-2.28.0-1.el9.noa 1.0 MB/s | 203 kB 00:00 2024-03-19T05:58:40.937 INFO:teuthology.orchestra.run.smithi017.stdout:(145/196): python3-cheroot-8.6.0-4.el9.noarch.r 60 kB/s | 172 kB 00:02 2024-03-19T05:58:41.029 INFO:teuthology.orchestra.run.smithi017.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 1.6 MB/s | 144 kB 00:00 2024-03-19T05:58:41.129 INFO:teuthology.orchestra.run.smithi017.stdout:(147/196): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-03-19T05:58:41.154 INFO:teuthology.orchestra.run.smithi017.stdout:(148/196): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-03-19T05:58:41.179 INFO:teuthology.orchestra.run.smithi017.stdout:(149/196): python3-jaraco-classes-3.2.1-5.el9.n 358 kB/s | 18 kB 00:00 2024-03-19T05:58:41.292 INFO:teuthology.orchestra.run.smithi153.stdout:(128/196): gperftools-libs-2.9.1-2.el9.x86_64.r 327 kB/s | 309 kB 00:00 2024-03-19T05:58:41.358 INFO:teuthology.orchestra.run.smithi153.stdout:(129/196): abseil-cpp-20211102.0-3.el9.x86_64.r 424 kB/s | 548 kB 00:01 2024-03-19T05:58:41.400 INFO:teuthology.orchestra.run.smithi153.stdout:(130/196): grpc-data-1.46.7-10.el9.noarch.rpm 180 kB/s | 19 kB 00:00 2024-03-19T05:58:41.535 INFO:teuthology.orchestra.run.smithi153.stdout:(131/196): libarrow-doc-9.0.0-10.el9.noarch.rpm 196 kB/s | 26 kB 00:00 2024-03-19T05:58:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:(132/196): liboath-2.6.7-2.el9.x86_64.rpm 419 kB/s | 49 kB 00:00 2024-03-19T05:58:41.776 INFO:teuthology.orchestra.run.smithi153.stdout:(133/196): libunwind-1.6.2-1.el9.x86_64.rpm 541 kB/s | 67 kB 00:00 2024-03-19T05:58:42.005 INFO:teuthology.orchestra.run.smithi017.stdout:(150/196): python3-jaraco-functools-3.5.0-2.el9 24 kB/s | 19 kB 00:00 2024-03-19T05:58:42.042 INFO:teuthology.orchestra.run.smithi153.stdout:(134/196): luarocks-3.9.2-1.el9.noarch.rpm 568 kB/s | 151 kB 00:00 2024-03-19T05:58:42.172 INFO:teuthology.orchestra.run.smithi017.stdout:(151/196): python3-jaraco-collections-3.0.0-8.e 23 kB/s | 23 kB 00:01 2024-03-19T05:58:43.135 INFO:teuthology.orchestra.run.smithi153.stdout:(135/196): parquet-libs-9.0.0-10.el9.x86_64.rpm 768 kB/s | 838 kB 00:01 2024-03-19T05:58:43.889 INFO:teuthology.orchestra.run.smithi017.stdout:(152/196): python3-kubernetes-26.1.0-2.el9.noar 609 kB/s | 1.0 MB 00:01 2024-03-19T05:58:43.926 INFO:teuthology.orchestra.run.smithi153.stdout:(136/196): python3-asyncssh-2.13.2-4.el9.noarch 692 kB/s | 548 kB 00:00 2024-03-19T05:58:43.931 INFO:teuthology.orchestra.run.smithi017.stdout:(153/196): python3-jaraco-text-3.2.0-6.el9.noar 10 kB/s | 20 kB 00:01 2024-03-19T05:58:44.085 INFO:teuthology.orchestra.run.smithi153.stdout:(137/196): python3-bcrypt-3.2.2-1.el9.x86_64.rp 276 kB/s | 43 kB 00:00 2024-03-19T05:58:44.202 INFO:teuthology.orchestra.run.smithi153.stdout:(138/196): python3-cachetools-4.2.4-1.el9.noarc 277 kB/s | 32 kB 00:00 2024-03-19T05:58:44.310 INFO:teuthology.orchestra.run.smithi153.stdout:(139/196): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2024-03-19T05:58:44.439 INFO:teuthology.orchestra.run.smithi017.stdout:(154/196): python3-more-itertools-8.12.0-2.el9. 155 kB/s | 79 kB 00:00 2024-03-19T05:58:44.498 INFO:teuthology.orchestra.run.smithi017.stdout:(155/196): python3-natsort-7.1.1-5.el9.noarch.r 999 kB/s | 58 kB 00:00 2024-03-19T05:58:44.602 INFO:teuthology.orchestra.run.smithi153.stdout:(140/196): python3-cheroot-8.6.0-4.el9.noarch.r 590 kB/s | 172 kB 00:00 2024-03-19T05:58:45.219 INFO:teuthology.orchestra.run.smithi153.stdout:(141/196): python3-cherrypy-18.6.1-2.el9.noarch 582 kB/s | 358 kB 00:00 2024-03-19T05:58:45.973 INFO:teuthology.orchestra.run.smithi017.stdout:(156/196): python3-pecan-1.4.2-3.el9.noarch.rpm 185 kB/s | 272 kB 00:01 2024-03-19T05:58:46.065 INFO:teuthology.orchestra.run.smithi017.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 181 kB/s | 16 kB 00:00 2024-03-19T05:58:46.278 INFO:teuthology.orchestra.run.smithi153.stdout:(142/196): python3-cmd2-2.4.2-2.el9.noarch.rpm 287 kB/s | 303 kB 00:01 2024-03-19T05:58:46.386 INFO:teuthology.orchestra.run.smithi153.stdout:(143/196): python3-colorama-0.4.4-12.el9.noarch 329 kB/s | 35 kB 00:00 2024-03-19T05:58:46.415 INFO:teuthology.orchestra.run.smithi017.stdout:(158/196): python3-logutils-0.3.5-21.el9.noarch 18 kB/s | 46 kB 00:02 2024-03-19T05:58:46.441 INFO:teuthology.orchestra.run.smithi017.stdout:(159/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 240 kB/s | 90 kB 00:00 2024-03-19T05:58:46.745 INFO:teuthology.orchestra.run.smithi153.stdout:(144/196): python3-google-auth-2.28.0-1.el9.noa 567 kB/s | 203 kB 00:00 2024-03-19T05:58:46.941 INFO:teuthology.orchestra.run.smithi017.stdout:(160/196): python3-repoze-lru-0.7-16.el9.noarch 62 kB/s | 31 kB 00:00 2024-03-19T05:58:47.041 INFO:teuthology.orchestra.run.smithi017.stdout:(161/196): python3-routes-2.5.1-5.el9.noarch.rp 1.9 MB/s | 188 kB 00:00 2024-03-19T05:58:47.208 INFO:teuthology.orchestra.run.smithi017.stdout:(162/196): python3-rsa-4.9-2.el9.noarch.rpm 356 kB/s | 59 kB 00:00 2024-03-19T05:58:47.267 INFO:teuthology.orchestra.run.smithi017.stdout:(163/196): python3-tempora-5.0.0-2.el9.noarch.r 622 kB/s | 36 kB 00:00 2024-03-19T05:58:47.317 INFO:teuthology.orchestra.run.smithi017.stdout:(164/196): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-19T05:58:47.550 INFO:teuthology.orchestra.run.smithi017.stdout:(165/196): python3-pyperclip-1.8.2-2.el9.noarch 25 kB/s | 28 kB 00:01 2024-03-19T05:58:48.028 INFO:teuthology.orchestra.run.smithi153.stdout:(145/196): libarrow-9.0.0-10.el9.x86_64.rpm 678 kB/s | 4.4 MB 00:06 2024-03-19T05:58:48.051 INFO:teuthology.orchestra.run.smithi017.stdout:(166/196): python3-webob-1.8.7-6.el9.noarch.rpm 313 kB/s | 230 kB 00:00 2024-03-19T05:58:48.312 INFO:teuthology.orchestra.run.smithi153.stdout:(146/196): python3-grpcio-tools-1.46.7-10.el9.x 511 kB/s | 144 kB 00:00 2024-03-19T05:58:48.426 INFO:teuthology.orchestra.run.smithi017.stdout:(167/196): python3-websocket-client-1.2.3-2.el9 103 kB/s | 90 kB 00:00 2024-03-19T05:58:48.446 INFO:teuthology.orchestra.run.smithi153.stdout:(147/196): python3-jaraco-8.2.1-3.el9.noarch.rp 81 kB/s | 11 kB 00:00 2024-03-19T05:58:48.569 INFO:teuthology.orchestra.run.smithi153.stdout:(148/196): python3-jaraco-classes-3.2.1-5.el9.n 145 kB/s | 18 kB 00:00 2024-03-19T05:58:48.679 INFO:teuthology.orchestra.run.smithi153.stdout:(149/196): python3-jaraco-collections-3.0.0-8.e 212 kB/s | 23 kB 00:00 2024-03-19T05:58:48.778 INFO:teuthology.orchestra.run.smithi017.stdout:(168/196): python3-werkzeug-2.0.3-3.el9.1.noarc 590 kB/s | 427 kB 00:00 2024-03-19T05:58:48.780 INFO:teuthology.orchestra.run.smithi153.stdout:(150/196): python3-jaraco-functools-3.5.0-2.el9 196 kB/s | 19 kB 00:00 2024-03-19T05:58:48.905 INFO:teuthology.orchestra.run.smithi153.stdout:(151/196): python3-jaraco-text-3.2.0-6.el9.noar 158 kB/s | 20 kB 00:00 2024-03-19T05:58:49.826 INFO:teuthology.orchestra.run.smithi017.stdout:(169/196): re2-20211101-3.el9.x86_64.rpm 183 kB/s | 192 kB 00:01 2024-03-19T05:58:50.522 INFO:teuthology.orchestra.run.smithi153.stdout:(152/196): python3-grpcio-1.46.7-10.el9.x86_64. 553 kB/s | 2.0 MB 00:03 2024-03-19T05:58:50.864 INFO:teuthology.orchestra.run.smithi153.stdout:(153/196): python3-kubernetes-26.1.0-2.el9.noar 534 kB/s | 1.0 MB 00:01 2024-03-19T05:58:50.889 INFO:teuthology.orchestra.run.smithi153.stdout:(154/196): python3-logutils-0.3.5-21.el9.noarch 126 kB/s | 46 kB 00:00 2024-03-19T05:58:50.998 INFO:teuthology.orchestra.run.smithi153.stdout:(155/196): python3-natsort-7.1.1-5.el9.noarch.r 536 kB/s | 58 kB 00:00 2024-03-19T05:58:51.065 INFO:teuthology.orchestra.run.smithi153.stdout:(156/196): python3-more-itertools-8.12.0-2.el9. 395 kB/s | 79 kB 00:00 2024-03-19T05:58:51.182 INFO:teuthology.orchestra.run.smithi153.stdout:(157/196): python3-portend-3.1.0-2.el9.noarch.r 142 kB/s | 16 kB 00:00 2024-03-19T05:58:51.415 INFO:teuthology.orchestra.run.smithi153.stdout:(158/196): python3-pyOpenSSL-21.0.0-1.el9.noarc 387 kB/s | 90 kB 00:00 2024-03-19T05:58:51.516 INFO:teuthology.orchestra.run.smithi153.stdout:(159/196): python3-pecan-1.4.2-3.el9.noarch.rpm 527 kB/s | 272 kB 00:00 2024-03-19T05:58:51.541 INFO:teuthology.orchestra.run.smithi153.stdout:(160/196): python3-pyperclip-1.8.2-2.el9.noarch 227 kB/s | 28 kB 00:00 2024-03-19T05:58:51.625 INFO:teuthology.orchestra.run.smithi153.stdout:(161/196): python3-repoze-lru-0.7-16.el9.noarch 285 kB/s | 31 kB 00:00 2024-03-19T05:58:51.733 INFO:teuthology.orchestra.run.smithi153.stdout:(162/196): python3-rsa-4.9-2.el9.noarch.rpm 550 kB/s | 59 kB 00:00 2024-03-19T05:58:51.811 INFO:teuthology.orchestra.run.smithi153.stdout:(163/196): python3-routes-2.5.1-5.el9.noarch.rp 702 kB/s | 188 kB 00:00 2024-03-19T05:58:51.852 INFO:teuthology.orchestra.run.smithi153.stdout:(164/196): python3-tempora-5.0.0-2.el9.noarch.r 303 kB/s | 36 kB 00:00 2024-03-19T05:58:51.919 INFO:teuthology.orchestra.run.smithi153.stdout:(165/196): python3-typing-extensions-4.4.0-2.el 473 kB/s | 51 kB 00:00 2024-03-19T05:58:52.103 INFO:teuthology.orchestra.run.smithi153.stdout:(166/196): python3-websocket-client-1.2.3-2.el9 491 kB/s | 90 kB 00:00 2024-03-19T05:58:52.228 INFO:teuthology.orchestra.run.smithi153.stdout:(167/196): python3-webob-1.8.7-6.el9.noarch.rpm 612 kB/s | 230 kB 00:00 2024-03-19T05:58:52.345 INFO:teuthology.orchestra.run.smithi153.stdout:(168/196): python3-zc-lockfile-2.0-10.el9.noarc 172 kB/s | 20 kB 00:00 2024-03-19T05:58:52.670 INFO:teuthology.orchestra.run.smithi153.stdout:(169/196): re2-20211101-3.el9.x86_64.rpm 591 kB/s | 192 kB 00:00 2024-03-19T05:58:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:(170/196): thrift-0.15.0-2.el9.x86_64.rpm 565 kB/s | 1.6 MB 00:02 2024-03-19T05:58:52.804 INFO:teuthology.orchestra.run.smithi153.stdout:(170/196): python3-werkzeug-2.0.3-3.el9.1.noarc 610 kB/s | 427 kB 00:00 2024-03-19T05:58:52.835 INFO:teuthology.orchestra.run.smithi017.stdout:(171/196): python3-zc-lockfile-2.0-10.el9.noarc 4.5 kB/s | 20 kB 00:04 2024-03-19T05:58:53.826 INFO:teuthology.orchestra.run.smithi017.stdout:(172/196): librbd1-19.0.0-1934.gb0ea271b.el9.x8 3.2 MB/s | 3.1 MB 00:00 2024-03-19T05:58:53.877 INFO:teuthology.orchestra.run.smithi017.stdout:(173/196): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-03-19T05:58:54.077 INFO:teuthology.orchestra.run.smithi017.stdout:(174/196): NetworkManager-1.47.2-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-03-19T05:58:54.177 INFO:teuthology.orchestra.run.smithi017.stdout:(175/196): NetworkManager-libnm-1.47.2-1.el9.x8 19 MB/s | 1.8 MB 00:00 2024-03-19T05:58:54.188 INFO:teuthology.orchestra.run.smithi153.stdout:(171/196): librados2-19.0.0-1934.gb0ea271b.el9. 2.4 MB/s | 3.4 MB 00:01 2024-03-19T05:58:54.219 INFO:teuthology.orchestra.run.smithi017.stdout:(176/196): NetworkManager-team-1.47.2-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-03-19T05:58:54.269 INFO:teuthology.orchestra.run.smithi017.stdout:(177/196): NetworkManager-tui-1.47.2-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-03-19T05:58:54.311 INFO:teuthology.orchestra.run.smithi017.stdout:(178/196): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-19T05:58:54.353 INFO:teuthology.orchestra.run.smithi017.stdout:(179/196): elfutils-debuginfod-client-0.190-2.e 895 kB/s | 36 kB 00:00 2024-03-19T05:58:54.403 INFO:teuthology.orchestra.run.smithi017.stdout:(180/196): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2024-03-19T05:58:54.454 INFO:teuthology.orchestra.run.smithi017.stdout:(181/196): elfutils-libs-0.190-2.el9.x86_64.rpm 5.1 MB/s | 256 kB 00:00 2024-03-19T05:58:54.495 INFO:teuthology.orchestra.run.smithi017.stdout:(182/196): libacl-2.3.1-4.el9.x86_64.rpm 564 kB/s | 23 kB 00:00 2024-03-19T05:58:54.546 INFO:teuthology.orchestra.run.smithi017.stdout:(183/196): libblkid-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 108 kB 00:00 2024-03-19T05:58:54.596 INFO:teuthology.orchestra.run.smithi017.stdout:(184/196): libfdisk-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 155 kB 00:00 2024-03-19T05:58:54.655 INFO:teuthology.orchestra.run.smithi017.stdout:(185/196): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-19T05:58:54.714 INFO:teuthology.orchestra.run.smithi017.stdout:(186/196): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-19T05:58:54.756 INFO:teuthology.orchestra.run.smithi017.stdout:(187/196): libuuid-2.37.4-18.el9.x86_64.rpm 701 kB/s | 29 kB 00:00 2024-03-19T05:58:54.839 INFO:teuthology.orchestra.run.smithi017.stdout:(188/196): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-03-19T05:58:54.921 INFO:teuthology.orchestra.run.smithi153.stdout:(172/196): thrift-0.15.0-2.el9.x86_64.rpm 720 kB/s | 1.6 MB 00:02 2024-03-19T05:58:54.939 INFO:teuthology.orchestra.run.smithi017.stdout:(189/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-03-19T05:58:55.057 INFO:teuthology.orchestra.run.smithi017.stdout:(190/196): util-linux-2.37.4-18.el9.x86_64.rpm 20 MB/s | 2.3 MB 00:00 2024-03-19T05:58:55.115 INFO:teuthology.orchestra.run.smithi017.stdout:(191/196): util-linux-core-2.37.4-18.el9.x86_64 7.9 MB/s | 465 kB 00:00 2024-03-19T05:58:55.157 INFO:teuthology.orchestra.run.smithi017.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 767 kB/s | 31 kB 00:00 2024-03-19T05:58:55.222 INFO:teuthology.orchestra.run.smithi153.stdout:(173/196): librbd1-19.0.0-1934.gb0ea271b.el9.x8 3.0 MB/s | 3.1 MB 00:01 2024-03-19T05:58:55.241 INFO:teuthology.orchestra.run.smithi017.stdout:(193/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-19T05:58:55.283 INFO:teuthology.orchestra.run.smithi017.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.8 MB/s | 74 kB 00:00 2024-03-19T05:58:55.322 INFO:teuthology.orchestra.run.smithi153.stdout:(174/196): xfsdump-3.1.12-4.el9.x86_64.rpm 806 kB/s | 321 kB 00:00 2024-03-19T05:58:55.374 INFO:teuthology.orchestra.run.smithi017.stdout:(195/196): librados2-19.0.0-1934.gb0ea271b.el9. 1.3 MB/s | 3.4 MB 00:02 2024-03-19T05:58:56.197 INFO:teuthology.orchestra.run.smithi153.stdout:(175/196): NetworkManager-1.47.2-1.el9.x86_64.r 2.4 MB/s | 2.3 MB 00:00 2024-03-19T05:58:56.297 INFO:teuthology.orchestra.run.smithi153.stdout:(176/196): NetworkManager-team-1.47.2-1.el9.x86 424 kB/s | 42 kB 00:00 2024-03-19T05:58:56.356 INFO:teuthology.orchestra.run.smithi153.stdout:(177/196): NetworkManager-libnm-1.47.2-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-03-19T05:58:56.406 INFO:teuthology.orchestra.run.smithi153.stdout:(178/196): NetworkManager-tui-1.47.2-1.el9.x86_ 2.3 MB/s | 248 kB 00:00 2024-03-19T05:58:56.465 INFO:teuthology.orchestra.run.smithi153.stdout:(179/196): acl-2.3.1-4.el9.x86_64.rpm 661 kB/s | 71 kB 00:00 2024-03-19T05:58:56.515 INFO:teuthology.orchestra.run.smithi153.stdout:(180/196): elfutils-debuginfod-client-0.190-2.e 338 kB/s | 36 kB 00:00 2024-03-19T05:58:56.574 INFO:teuthology.orchestra.run.smithi153.stdout:(181/196): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-03-19T05:58:56.632 INFO:teuthology.orchestra.run.smithi153.stdout:(182/196): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-03-19T05:58:56.683 INFO:teuthology.orchestra.run.smithi153.stdout:(183/196): libacl-2.3.1-4.el9.x86_64.rpm 213 kB/s | 23 kB 00:00 2024-03-19T05:58:56.741 INFO:teuthology.orchestra.run.smithi153.stdout:(184/196): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-19T05:58:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:(185/196): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-03-19T05:58:56.858 INFO:teuthology.orchestra.run.smithi153.stdout:(186/196): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-19T05:58:56.901 INFO:teuthology.orchestra.run.smithi153.stdout:(187/196): libsmartcols-2.37.4-18.el9.x86_64.rp 591 kB/s | 64 kB 00:00 2024-03-19T05:58:56.968 INFO:teuthology.orchestra.run.smithi153.stdout:(188/196): libuuid-2.37.4-18.el9.x86_64.rpm 266 kB/s | 29 kB 00:00 2024-03-19T05:58:57.051 INFO:teuthology.orchestra.run.smithi153.stdout:(189/196): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-03-19T05:58:57.776 INFO:teuthology.orchestra.run.smithi153.stdout:(190/196): openssl-libs-3.0.7-27.el9.x86_64.rpm 2.7 MB/s | 2.2 MB 00:00 2024-03-19T05:58:57.918 INFO:teuthology.orchestra.run.smithi153.stdout:(191/196): util-linux-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 2.3 MB 00:00 2024-03-19T05:58:58.044 INFO:teuthology.orchestra.run.smithi153.stdout:(192/196): util-linux-user-2.37.4-18.el9.x86_64 251 kB/s | 31 kB 00:00 2024-03-19T05:58:58.327 INFO:teuthology.orchestra.run.smithi153.stdout:(193/196): util-linux-core-2.37.4-18.el9.x86_64 849 kB/s | 465 kB 00:00 2024-03-19T05:58:58.419 INFO:teuthology.orchestra.run.smithi153.stdout:(194/196): libacl-devel-2.3.1-4.el9.x86_64.rpm 820 kB/s | 74 kB 00:00 2024-03-19T05:58:59.678 INFO:teuthology.orchestra.run.smithi153.stdout:(195/196): xfsprogs-6.3.0-1.el9.x86_64.rpm 673 kB/s | 1.1 MB 00:01 2024-03-19T05:59:12.560 INFO:teuthology.orchestra.run.smithi153.stdout:(196/196): ceph-test-debuginfo-19.0.0-1934.gb0e 7.6 MB/s | 675 MB 01:28 2024-03-19T05:59:12.570 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:59:12.570 INFO:teuthology.orchestra.run.smithi153.stdout:Total 12 MB/s | 2.2 GB 03:09 2024-03-19T05:59:13.985 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-19T05:59:14.371 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-19T05:59:14.372 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-19T05:59:16.681 INFO:teuthology.orchestra.run.smithi017.stdout:(196/196): ceph-test-debuginfo-19.0.0-1934.gb0e 7.0 MB/s | 675 MB 01:36 2024-03-19T05:59:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-19T05:59:16.685 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 2.2 GB 03:18 2024-03-19T05:59:18.141 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-19T05:59:18.554 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-19T05:59:18.554 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-19T05:59:28.644 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-19T05:59:28.645 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-19T05:59:33.589 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-19T05:59:33.590 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-19T05:59:48.174 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-19T05:59:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-03-19T05:59:51.002 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_6 2/220 2024-03-19T05:59:51.065 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-03-19T05:59:51.117 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-19T05:59:51.158 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-19T05:59:51.242 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-03-19T05:59:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-03-19T05:59:51.419 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-03-19T05:59:51.450 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-03-19T05:59:51.547 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-03-19T05:59:51.964 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-03-19T05:59:52.022 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T05:59:52.172 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T05:59:52.198 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 12/220 2024-03-19T05:59:52.317 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 12/220 2024-03-19T05:59:52.364 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 13/220 2024-03-19T05:59:52.429 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/220 2024-03-19T05:59:52.732 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-03-19T05:59:52.788 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/220 2024-03-19T05:59:52.811 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T05:59:52.961 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T05:59:52.996 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 18/220 2024-03-19T05:59:53.086 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 18/220 2024-03-19T05:59:53.131 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-03-19T05:59:53.156 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-19T05:59:53.230 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-19T05:59:53.533 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-19T05:59:53.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-19T05:59:53.632 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-03-19T05:59:53.933 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-03-19T05:59:53.954 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-19T05:59:54.096 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-03-19T05:59:54.173 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-03-19T05:59:54.338 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T05:59:54.433 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T05:59:54.733 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T05:59:54.897 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-03-19T05:59:55.020 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-03-19T05:59:55.055 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-03-19T05:59:55.090 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-03-19T05:59:55.145 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-03-19T05:59:55.245 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-03-19T05:59:55.318 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-03-19T05:59:55.362 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-03-19T05:59:55.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-03-19T05:59:55.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-03-19T05:59:55.565 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-03-19T05:59:55.607 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-03-19T05:59:55.638 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-03-19T05:59:55.751 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-03-19T05:59:55.785 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9. 40/220 2024-03-19T05:59:55.841 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el 41/220 2024-03-19T05:59:55.882 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_6 42/220 2024-03-19T05:59:55.999 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-03-19T05:59:56.062 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-03-19T05:59:56.170 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-03-19T05:59:56.347 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-03-19T05:59:56.413 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-03-19T05:59:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/220 2024-03-19T05:59:56.900 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_6 2/220 2024-03-19T05:59:56.966 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 3/220 2024-03-19T05:59:57.005 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-19T05:59:57.041 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 4/220 2024-03-19T05:59:57.090 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-03-19T05:59:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/220 2024-03-19T05:59:57.195 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-03-19T05:59:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/220 2024-03-19T05:59:57.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/220 2024-03-19T05:59:57.303 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-03-19T05:59:57.306 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/220 2024-03-19T05:59:57.361 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-19T05:59:57.392 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-19T05:59:57.401 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/220 2024-03-19T05:59:57.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/220 2024-03-19T05:59:57.515 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-03-19T05:59:57.571 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_6 54/220 2024-03-19T05:59:57.619 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-03-19T05:59:57.807 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/220 2024-03-19T05:59:57.838 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T05:59:58.014 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-03-19T05:59:58.106 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T05:59:58.131 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 12/220 2024-03-19T05:59:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-03-19T05:59:58.253 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 12/220 2024-03-19T05:59:58.291 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 13/220 2024-03-19T05:59:58.348 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-03-19T05:59:58.358 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/220 2024-03-19T05:59:58.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-03-19T05:59:58.611 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-03-19T05:59:58.655 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 15/220 2024-03-19T05:59:58.677 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-03-19T05:59:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.11-1.el9.x86_64 16/220 2024-03-19T05:59:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T05:59:58.777 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-03-19T05:59:58.876 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-03-19T05:59:58.918 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T05:59:58.919 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-03-19T05:59:58.953 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 18/220 2024-03-19T05:59:58.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-03-19T05:59:59.031 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-03-19T05:59:59.054 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 18/220 2024-03-19T05:59:59.067 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-03-19T05:59:59.107 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 19/220 2024-03-19T05:59:59.138 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-19T05:59:59.147 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-03-19T05:59:59.204 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 20/220 2024-03-19T05:59:59.214 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-03-19T05:59:59.409 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-03-19T05:59:59.473 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-03-19T05:59:59.506 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-19T05:59:59.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-03-19T05:59:59.542 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 21/220 2024-03-19T05:59:59.560 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-03-19T05:59:59.580 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 22/220 2024-03-19T05:59:59.709 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-03-19T05:59:59.758 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/220 2024-03-19T05:59:59.805 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-03-19T05:59:59.835 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 23/220 2024-03-19T05:59:59.841 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-03-19T05:59:59.874 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-03-19T05:59:59.996 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-03-19T06:00:00.036 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-03-19T06:00:00.083 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 24/220 2024-03-19T06:00:00.207 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-03-19T06:00:00.246 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T06:00:00.341 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-03-19T06:00:00.393 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-03-19T06:00:00.416 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T06:00:00.462 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-03-19T06:00:00.537 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-03-19T06:00:00.741 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 25/220 2024-03-19T06:00:00.786 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-03-19T06:00:00.846 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-03-19T06:00:00.925 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-3.el9.x86_64 26/220 2024-03-19T06:00:01.023 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-03-19T06:00:01.046 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 27/220 2024-03-19T06:00:01.077 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/220 2024-03-19T06:00:01.080 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 28/220 2024-03-19T06:00:01.116 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 29/220 2024-03-19T06:00:01.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-03-19T06:00:01.155 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-03-19T06:00:01.173 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/220 2024-03-19T06:00:01.196 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-03-19T06:00:01.242 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-03-19T06:00:01.287 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/220 2024-03-19T06:00:01.319 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-03-19T06:00:01.356 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/220 2024-03-19T06:00:01.378 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-03-19T06:00:01.406 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/220 2024-03-19T06:00:01.426 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-03-19T06:00:01.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 34/220 2024-03-19T06:00:01.553 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-03-19T06:00:01.561 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 35/220 2024-03-19T06:00:01.621 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-03-19T06:00:01.626 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/220 2024-03-19T06:00:01.657 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-03-19T06:00:01.676 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/220 2024-03-19T06:00:01.715 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-5.4.4-4.el9.x86_64 38/220 2024-03-19T06:00:01.722 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-03-19T06:00:01.768 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-03-19T06:00:01.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 39/220 2024-03-19T06:00:01.910 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9. 40/220 2024-03-19T06:00:01.913 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-03-19T06:00:01.966 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el 41/220 2024-03-19T06:00:02.000 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_6 42/220 2024-03-19T06:00:02.029 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-03-19T06:00:02.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-03-19T06:00:02.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-03-19T06:00:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 43/220 2024-03-19T06:00:02.173 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-03-19T06:00:02.198 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : luarocks-3.9.2-1.el9.noarch 44/220 2024-03-19T06:00:02.321 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 45/220 2024-03-19T06:00:02.321 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-03-19T06:00:02.390 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-03-19T06:00:02.505 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 46/220 2024-03-19T06:00:02.573 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 47/220 2024-03-19T06:00:03.282 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 48/220 2024-03-19T06:00:03.361 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-03-19T06:00:03.375 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 49/220 2024-03-19T06:00:03.406 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-03-19T06:00:03.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-03-19T06:00:03.493 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-03-19T06:00:03.503 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 50/220 2024-03-19T06:00:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-19T06:00:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 51/220 2024-03-19T06:00:03.614 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-03-19T06:00:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 52/220 2024-03-19T06:00:03.665 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-03-19T06:00:03.744 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 53/220 2024-03-19T06:00:03.802 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_6 54/220 2024-03-19T06:00:03.848 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 55/220 2024-03-19T06:00:03.900 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-03-19T06:00:03.937 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-03-19T06:00:04.030 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-03-19T06:00:04.249 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/220 2024-03-19T06:00:04.425 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/220 2024-03-19T06:00:04.517 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/220 2024-03-19T06:00:04.578 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/220 2024-03-19T06:00:04.819 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/220 2024-03-19T06:00:04.832 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-03-19T06:00:04.872 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 61/220 2024-03-19T06:00:04.954 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/220 2024-03-19T06:00:04.965 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-03-19T06:00:05.057 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/220 2024-03-19T06:00:05.097 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/220 2024-03-19T06:00:05.138 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/220 2024-03-19T06:00:05.207 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/220 2024-03-19T06:00:05.254 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/220 2024-03-19T06:00:05.320 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/220 2024-03-19T06:00:05.385 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/220 2024-03-19T06:00:05.590 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/220 2024-03-19T06:00:05.651 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/220 2024-03-19T06:00:05.689 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/220 2024-03-19T06:00:05.748 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/220 2024-03-19T06:00:05.894 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/220 2024-03-19T06:00:05.940 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 75/220 2024-03-19T06:00:05.987 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/220 2024-03-19T06:00:06.022 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/220 2024-03-19T06:00:06.055 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/220 2024-03-19T06:00:06.250 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/220 2024-03-19T06:00:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/220 2024-03-19T06:00:06.516 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-03-19T06:00:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/220 2024-03-19T06:00:06.615 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-03-19T06:00:06.641 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/220 2024-03-19T06:00:06.654 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-03-19T06:00:06.685 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-03-19T06:00:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/220 2024-03-19T06:00:06.725 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-03-19T06:00:06.778 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/220 2024-03-19T06:00:07.033 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/220 2024-03-19T06:00:07.095 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/220 2024-03-19T06:00:07.103 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-03-19T06:00:07.139 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 125/220 2024-03-19T06:00:07.259 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 125/220 2024-03-19T06:00:07.272 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/220 2024-03-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 126/220 2024-03-19T06:00:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/220 2024-03-19T06:00:07.355 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-03-19T06:00:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/220 2024-03-19T06:00:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-15.el9.x86_64 90/220 2024-03-19T06:00:07.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 91/220 2024-03-19T06:00:07.493 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 92/220 2024-03-19T06:00:07.560 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 93/220 2024-03-19T06:00:07.628 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 94/220 2024-03-19T06:00:07.677 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 95/220 2024-03-19T06:00:07.822 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 96/220 2024-03-19T06:00:07.864 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-03-19T06:00:07.900 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 129/220 2024-03-19T06:00:07.975 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 129/220 2024-03-19T06:00:08.002 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 130/220 2024-03-19T06:00:08.109 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 97/220 2024-03-19T06:00:08.153 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 98/220 2024-03-19T06:00:08.234 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 99/220 2024-03-19T06:00:08.297 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 100/220 2024-03-19T06:00:08.462 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 101/220 2024-03-19T06:00:08.590 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 102/220 2024-03-19T06:00:08.647 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 103/220 2024-03-19T06:00:08.692 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 104/220 2024-03-19T06:00:08.753 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 105/220 2024-03-19T06:00:08.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 106/220 2024-03-19T06:00:08.966 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 107/220 2024-03-19T06:00:09.976 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 108/220 2024-03-19T06:00:10.031 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 109/220 2024-03-19T06:00:10.065 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 110/220 2024-03-19T06:00:10.130 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 111/220 2024-03-19T06:00:10.246 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 112/220 2024-03-19T06:00:10.290 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 113/220 2024-03-19T06:00:10.492 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:10.531 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:10.534 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 114/220 2024-03-19T06:00:10.562 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 115/220 2024-03-19T06:00:10.664 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 116/220 2024-03-19T06:00:11.151 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:11.218 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 132/220 2024-03-19T06:00:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 132/220 2024-03-19T06:00:11.405 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-19T06:00:11.405 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-19T06:00:11.405 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:11.452 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 133/220 2024-03-19T06:00:11.501 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 117/220 2024-03-19T06:00:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 118/220 2024-03-19T06:00:13.259 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 119/220 2024-03-19T06:00:13.350 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 120/220 2024-03-19T06:00:13.394 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 121/220 2024-03-19T06:00:13.427 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-16.el9.x86_64 122/220 2024-03-19T06:00:13.469 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/220 2024-03-19T06:00:13.863 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/220 2024-03-19T06:00:13.890 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 125/220 2024-03-19T06:00:14.012 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 125/220 2024-03-19T06:00:14.047 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 126/220 2024-03-19T06:00:14.103 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/220 2024-03-19T06:00:14.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/220 2024-03-19T06:00:14.669 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 129/220 2024-03-19T06:00:14.751 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 129/220 2024-03-19T06:00:14.779 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 130/220 2024-03-19T06:00:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:17.426 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:18.084 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 131/220 2024-03-19T06:00:18.129 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 132/220 2024-03-19T06:00:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 132/220 2024-03-19T06:00:18.316 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-19T06:00:18.316 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-19T06:00:18.316 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:18.355 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 133/220 2024-03-19T06:00:25.228 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 133/220 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-03-19T06:00:25.229 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:25.482 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 134/220 2024-03-19T06:00:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 134/220 2024-03-19T06:00:25.531 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:25.531 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-19T06:00:25.531 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:27.159 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 135/220 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 135/220 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T06:00:27.233 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:27.459 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 136/220 2024-03-19T06:00:27.525 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 136/220 2024-03-19T06:00:27.525 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:27.525 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-19T06:00:27.525 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T06:00:27.525 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T06:00:27.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:28.010 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 137/220 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 137/220 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T06:00:28.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:28.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-03-19T06:00:28.801 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 139/220 2024-03-19T06:00:28.840 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 139/220 2024-03-19T06:00:28.892 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.e 140/220 2024-03-19T06:00:28.992 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b. 141/220 2024-03-19T06:00:29.018 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 142/220 2024-03-19T06:00:29.344 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 142/220 2024-03-19T06:00:29.377 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 143/220 2024-03-19T06:00:30.502 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 143/220 2024-03-19T06:00:30.536 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 144/220 2024-03-19T06:00:30.680 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 144/220 2024-03-19T06:00:30.863 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el 145/220 2024-03-19T06:00:30.896 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 146/220 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 146/220 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T06:00:30.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:31.030 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 147/220 2024-03-19T06:00:31.068 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 147/220 2024-03-19T06:00:31.141 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 148/220 2024-03-19T06:00:31.634 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 133/220 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-03-19T06:00:31.635 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:31.871 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 134/220 2024-03-19T06:00:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 134/220 2024-03-19T06:00:31.923 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:31.923 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-19T06:00:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:32.130 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-03-19T06:00:32.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 150/220 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 150/220 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:00:32.255 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 151/220 2024-03-19T06:00:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 151/220 2024-03-19T06:00:32.379 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:32.379 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-19T06:00:32.379 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:32.458 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 152/220 2024-03-19T06:00:32.535 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 152/220 2024-03-19T06:00:32.535 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:32.536 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-19T06:00:32.536 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:00:32.536 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:00:32.536 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:32.901 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 153/220 2024-03-19T06:00:32.970 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 153/220 2024-03-19T06:00:32.970 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:32.971 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-19T06:00:32.971 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T06:00:32.971 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T06:00:32.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:00:33.615 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 135/220 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 135/220 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-19T06:00:33.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 136/220 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 136/220 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-19T06:00:34.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 137/220 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 137/220 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-19T06:00:34.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:34.752 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 138/220 2024-03-19T06:00:35.334 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 139/220 2024-03-19T06:00:35.362 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 139/220 2024-03-19T06:00:35.414 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.e 140/220 2024-03-19T06:00:35.518 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b. 141/220 2024-03-19T06:00:35.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 142/220 2024-03-19T06:00:35.893 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 142/220 2024-03-19T06:00:35.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 143/220 2024-03-19T06:00:37.096 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 143/220 2024-03-19T06:00:37.133 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 144/220 2024-03-19T06:00:37.287 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 144/220 2024-03-19T06:00:37.467 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el 145/220 2024-03-19T06:00:37.493 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 146/220 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 146/220 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-19T06:00:37.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:37.621 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 147/220 2024-03-19T06:00:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 147/220 2024-03-19T06:00:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 148/220 2024-03-19T06:00:37.764 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 154/220 2024-03-19T06:00:37.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 155/220 2024-03-19T06:00:37.846 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 156/220 2024-03-19T06:00:37.908 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-03-19T06:00:38.198 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 158/220 2024-03-19T06:00:38.324 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/220 2024-03-19T06:00:38.373 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 160/220 2024-03-19T06:00:38.428 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-03-19T06:00:38.488 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-03-19T06:00:38.541 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-03-19T06:00:38.576 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_ 164/220 2024-03-19T06:00:38.631 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-03-19T06:00:38.682 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-03-19T06:00:38.750 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/220 2024-03-19T06:00:38.770 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-03-19T06:00:38.782 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 150/220 2024-03-19T06:00:38.852 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 150/220 2024-03-19T06:00:38.852 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:38.852 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-19T06:00:38.852 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:00:38.852 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-19T06:00:38.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:38.893 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-03-19T06:00:38.899 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 151/220 2024-03-19T06:00:38.955 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-03-19T06:00:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 151/220 2024-03-19T06:00:38.994 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:38.994 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-19T06:00:38.994 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:39.075 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 152/220 2024-03-19T06:00:39.180 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 152/220 2024-03-19T06:00:39.181 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:39.181 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-19T06:00:39.181 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:00:39.181 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-19T06:00:39.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:39.576 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 153/220 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 153/220 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-19T06:00:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:00:39.875 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:39.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:39.988 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:44.707 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 154/220 2024-03-19T06:00:44.750 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 155/220 2024-03-19T06:00:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 156/220 2024-03-19T06:00:44.818 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/220 2024-03-19T06:00:45.088 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 158/220 2024-03-19T06:00:45.223 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/220 2024-03-19T06:00:45.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 160/220 2024-03-19T06:00:45.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/220 2024-03-19T06:00:45.406 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/220 2024-03-19T06:00:45.461 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/220 2024-03-19T06:00:45.504 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_ 164/220 2024-03-19T06:00:45.549 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/220 2024-03-19T06:00:45.600 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 166/220 2024-03-19T06:00:45.689 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 167/220 2024-03-19T06:00:45.803 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 168/220 2024-03-19T06:00:45.848 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/220 2024-03-19T06:00:46.802 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:46.845 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:46.906 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 170/220 2024-03-19T06:00:47.668 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 171/220 2024-03-19T06:00:55.003 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 171/220 2024-03-19T06:01:30.520 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 172/220 2024-03-19T06:01:31.197 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el 173/220 2024-03-19T06:01:31.375 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 174/220 2024-03-19T06:01:36.122 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 175/220 2024-03-19T06:01:38.334 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 176/220 2024-03-19T06:01:40.705 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 172/220 2024-03-19T06:01:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el 173/220 2024-03-19T06:01:41.587 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 174/220 2024-03-19T06:01:46.605 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 175/220 2024-03-19T06:01:48.694 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 177/220 2024-03-19T06:01:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 176/220 2024-03-19T06:01:59.835 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 177/220 2024-03-19T06:02:18.620 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 178/220 2024-03-19T06:02:31.351 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 178/220 2024-03-19T06:02:38.623 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 179/220 2024-03-19T06:02:51.515 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 179/220 2024-03-19T06:03:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.e 180/220 2024-03-19T06:03:51.588 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 181/220 2024-03-19T06:03:52.243 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9 182/220 2024-03-19T06:03:57.848 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b 183/220 2024-03-19T06:04:04.715 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 184/220 2024-03-19T06:04:04.806 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 185/220 2024-03-19T06:04:04.905 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b 186/220 2024-03-19T06:04:05.043 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b. 187/220 2024-03-19T06:04:05.113 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el 188/220 2024-03-19T06:04:05.197 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el 189/220 2024-03-19T06:04:07.876 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.e 180/220 2024-03-19T06:04:08.519 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 181/220 2024-03-19T06:04:08.568 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9 182/220 2024-03-19T06:04:11.175 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 190/220 2024-03-19T06:04:11.340 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9 191/220 2024-03-19T06:04:12.598 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 192/220 2024-03-19T06:04:14.245 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b 183/220 2024-03-19T06:04:14.334 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-03-19T06:04:14.650 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-03-19T06:04:14.813 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-03-19T06:04:14.857 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-03-19T06:04:14.889 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-03-19T06:04:14.924 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-03-19T06:04:14.965 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-03-19T06:04:14.966 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-19T06:04:15.120 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-19T06:04:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-03-19T06:04:15.162 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-19T06:04:15.316 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-19T06:04:15.360 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-03-19T06:04:15.407 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-03-19T06:04:15.439 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-03-19T06:04:15.471 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-03-19T06:04:15.546 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-03-19T06:04:15.619 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-03-19T06:04:15.659 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-03-19T06:04:15.693 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-03-19T06:04:15.727 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-03-19T06:04:15.760 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-03-19T06:04:15.794 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-03-19T06:04:15.829 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:15.830 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:16.151 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:16.152 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-19T06:04:16.300 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-19T06:04:16.329 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-03-19T06:04:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-03-19T06:04:16.424 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-03-19T06:04:16.464 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-03-19T06:04:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-19T06:04:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-19T06:04:16.835 INFO:teuthology.orchestra.run.smithi153.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-19T06:04:16.835 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:20.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 184/220 2024-03-19T06:04:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 185/220 2024-03-19T06:04:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b 186/220 2024-03-19T06:04:21.144 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b. 187/220 2024-03-19T06:04:21.208 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el 188/220 2024-03-19T06:04:21.292 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el 189/220 2024-03-19T06:04:23.802 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 1/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 2/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 3/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 4/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el 5/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_6 6/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 7/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 8/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 9/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 12/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 13/220 2024-03-19T06:04:23.803 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 14/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 15/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 16/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 18/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 19/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.e 20/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 21/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 22/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 23/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 24/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 25/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_ 26/220 2024-03-19T06:04:23.804 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 27/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9 28/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 29/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_6 30/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b 31/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 32/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 33/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 34/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 35/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el 36/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9. 37/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_6 38/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b 39/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 40/220 2024-03-19T06:04:23.805 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b. 41/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 42/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el 43/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 44/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el 45/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 46/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 47/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 48/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9 49/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 50/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 51/220 2024-03-19T06:04:23.806 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b. 52/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 53/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 54/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 55/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el 56/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 57/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.e 58/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 59/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 60/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 61/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-03-19T06:04:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-03-19T06:04:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.11-1.el9.x86_64 80/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 81/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 82/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 83/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-03-19T06:04:23.809 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-03-19T06:04:23.810 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 106/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 107/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 108/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 109/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 110/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 111/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 112/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 113/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-16.el9.x86_64 114/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 115/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 116/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 117/220 2024-03-19T06:04:23.811 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 118/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 119/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 120/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 121/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 122/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 123/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 124/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 125/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-03-19T06:04:23.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-03-19T06:04:23.813 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 146/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-03-19T06:04:23.814 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-03-19T06:04:23.815 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 173/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 175/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 179/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 181/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 183/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 185/220 2024-03-19T06:04:23.816 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-03-19T06:04:23.817 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-03-19T06:04:23.818 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-03-19T06:04:23.819 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-03-19T06:04:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: acl-2.3.1-4.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-19T06:04:26.638 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.639 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.640 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.641 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.642 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-16.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.643 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-19T06:04:26.644 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-19T06:04:26.645 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.11-1.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.646 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-19T06:04:26.647 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-19T06:04:26.648 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-19T06:04:26.649 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-19T06:04:26.650 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.651 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-19T06:04:26.652 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-19T06:04:26.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:26.653 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-19T06:04:27.592 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 190/220 2024-03-19T06:04:27.768 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9 191/220 2024-03-19T06:04:28.037 DEBUG:teuthology.parallel:result is None 2024-03-19T06:04:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 192/220 2024-03-19T06:04:29.207 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 193/220 2024-03-19T06:04:29.261 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 194/220 2024-03-19T06:04:29.394 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 195/220 2024-03-19T06:04:29.442 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 196/220 2024-03-19T06:04:29.476 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 197/220 2024-03-19T06:04:29.509 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 198/220 2024-03-19T06:04:29.544 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 199/220 2024-03-19T06:04:29.544 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-19T06:04:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 200/220 2024-03-19T06:04:29.739 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 201/220 2024-03-19T06:04:29.740 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-19T06:04:29.887 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 202/220 2024-03-19T06:04:29.930 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 203/220 2024-03-19T06:04:29.992 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 204/220 2024-03-19T06:04:30.026 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 205/220 2024-03-19T06:04:30.059 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 206/220 2024-03-19T06:04:30.134 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 207/220 2024-03-19T06:04:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 208/220 2024-03-19T06:04:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 209/220 2024-03-19T06:04:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 210/220 2024-03-19T06:04:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 211/220 2024-03-19T06:04:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 212/220 2024-03-19T06:04:30.397 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 213/220 2024-03-19T06:04:30.434 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:30.435 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:30.765 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 214/220 2024-03-19T06:04:30.765 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-19T06:04:30.895 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 215/220 2024-03-19T06:04:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 216/220 2024-03-19T06:04:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 217/220 2024-03-19T06:04:31.049 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 218/220 2024-03-19T06:04:31.093 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 219/220 2024-03-19T06:04:31.218 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-19T06:04:31.475 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 220/220 2024-03-19T06:04:31.475 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-19T06:04:31.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 1/220 2024-03-19T06:04:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 2/220 2024-03-19T06:04:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 3/220 2024-03-19T06:04:40.100 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 4/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el 5/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_6 6/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 7/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 8/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1934.gb0ea2 9/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-1 10/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 11/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 12/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 13/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 14/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 15/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 16/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 17/220 2024-03-19T06:04:40.101 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 18/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 19/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.e 20/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 21/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 22/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 23/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 24/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 25/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_ 26/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 27/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9 28/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 29/220 2024-03-19T06:04:40.102 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_6 30/220 2024-03-19T06:04:40.120 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b 31/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9. 32/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86 33/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 34/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 35/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el 36/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9. 37/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_6 38/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b 39/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 40/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b. 41/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 42/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el 43/220 2024-03-19T06:04:40.121 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 44/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el 45/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 46/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x 47/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 48/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9 49/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 50/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x8 51/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b. 52/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noa 53/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.n 54/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0e 55/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el 56/220 2024-03-19T06:04:40.122 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 57/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.e 58/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 59/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 60/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 61/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 62/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 63/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/220 2024-03-19T06:04:40.123 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 70/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 71/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 72/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 73/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 74/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 75/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-5.4.4-4.el9.x86_64 76/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 77/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 78/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 79/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.11-1.el9.x86_64 80/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 81/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 82/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 83/220 2024-03-19T06:04:40.124 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 84/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 85/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 86/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 87/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 88/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 89/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 90/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 91/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 93/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 94/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 95/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 96/220 2024-03-19T06:04:40.125 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 97/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 98/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 99/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 100/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 101/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 102/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 103/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 104/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 105/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 106/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 107/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 108/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 109/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 110/220 2024-03-19T06:04:40.126 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 111/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 112/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 113/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-16.el9.x86_64 114/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 115/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 116/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 117/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 118/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 119/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 120/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 121/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 122/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 123/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 124/220 2024-03-19T06:04:40.127 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 125/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 126/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 127/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 128/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 129/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 130/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 131/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 132/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 133/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 134/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 135/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 136/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 137/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 138/220 2024-03-19T06:04:40.128 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 139/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 140/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 141/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 142/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 143/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 144/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 145/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 146/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 147/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 148/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 149/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 150/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 151/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 152/220 2024-03-19T06:04:40.129 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 153/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 154/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 155/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 156/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 157/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 158/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 159/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 160/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 161/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 162/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 163/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 164/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 165/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 166/220 2024-03-19T06:04:40.130 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 167/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 168/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 169/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 170/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-3.el9.x86_64 171/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 172/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 173/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 174/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 175/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 176/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 179/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 180/220 2024-03-19T06:04:40.131 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 181/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 182/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 183/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 184/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 185/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 186/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-4.el9.x86_64 187/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-3.el9.x86_64 188/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 189/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 190/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 191/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 192/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 193/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 194/220 2024-03-19T06:04:40.132 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 195/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 196/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 197/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 198/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 199/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 200/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 201/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 202/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 203/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 204/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 205/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 206/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 207/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 208/220 2024-03-19T06:04:40.133 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 209/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 210/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 211/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 212/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 213/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 214/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 215/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 216/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 217/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 218/220 2024-03-19T06:04:40.134 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 219/220 2024-03-19T06:04:42.875 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 220/220 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: acl-2.3.1-4.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.876 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-19T06:04:42.877 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.878 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.879 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-shell-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.880 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:19.0.0-1934.gb0ea271b.el9.noarch 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-16.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-19T06:04:42.881 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.882 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: lua-5.4.4-4.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-19T06:04:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.11-1.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-19T06:04:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-19T06:04:42.885 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-19T06:04:42.886 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-19T06:04:42.887 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-19T06:04:42.888 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-19T06:04:42.889 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-debuginfo-2:19.0.0-1934.gb0ea271b.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-3.el9.x86_64 2024-03-19T06:04:42.890 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:42.891 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-19T06:04:44.283 DEBUG:teuthology.parallel:result is None 2024-03-19T06:04:44.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:04:44.426 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-19T06:04:44.487 INFO:teuthology.orchestra.run.smithi017.stdout:19.0.0-1934.gb0ea271b.el9 2024-03-19T06:04:44.488 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1934.gb0ea271b.el9 2024-03-19T06:04:44.488 INFO:teuthology.task.install:The correct ceph version 19.0.0-1934.gb0ea271b is installed. 2024-03-19T06:04:44.490 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:04:44.632 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-19T06:04:44.704 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-1934.gb0ea271b.el9 2024-03-19T06:04:44.704 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1934.gb0ea271b.el9 2024-03-19T06:04:44.704 INFO:teuthology.task.install:The correct ceph version 19.0.0-1934.gb0ea271b is installed. 2024-03-19T06:04:44.707 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-19T06:04:44.708 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:44.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T06:04:44.789 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:44.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-19T06:04:44.895 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-19T06:04:44.895 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:44.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T06:04:44.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T06:04:45.108 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:45.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-03-19T06:04:45.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-19T06:04:45.347 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-19T06:04:45.347 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:45.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T06:04:45.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T06:04:45.540 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:45.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-19T06:04:45.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-19T06:04:45.778 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-19T06:04:45.778 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:45.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T06:04:45.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T06:04:45.976 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:45.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-03-19T06:04:46.073 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-19T06:04:46.209 INFO:teuthology.run_tasks:Running task ceph... 2024-03-19T06:04:46.290 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-19T06:04:46.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-03-19T06:04:46.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-03-19T06:04:46.397 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-19T06:04:46.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-19T06:04:46.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-19T06:04:46.501 INFO:tasks.ceph:Creating extra log directories... 2024-03-19T06:04:46.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-19T06:04:46.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-19T06:04:46.613 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-19T06:04:46.613 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-19T06:04:46.613 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-19T06:04:46.613 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:46.613 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-19T06:04:46.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-19T06:04:46.922 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-19T06:04:47.058 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:47.058 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-19T06:04:47.115 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-19T06:04:47.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-19T06:04:47.490 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-19T06:04:47.490 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-19T06:04:47.491 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654', 'branch': 'wip-vshankar-testing-20240307.022905', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7610654', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240307.022905'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240307.022905', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6045, 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'sleep_before_teardown': 0, 'subset': '832/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240307.022905', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhv7qFZyWRdrRw/kQhLCjydPW/ut9Wadvozb5N1CCcNB2M95CrukWaHtca0MwA30ZUD5cuffW1pjmlPgIVM7+k=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBtcYq0LvT3OOwvk04JWyKVOO+iL1IlO1BdewEMONovlw/INthFFF9ocNr0LDRcmAHlmoQHb8T4U7lz7Jd8DvY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '908b6b276e8f14e16032b32a9770077cd37b6bd4'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-19_04:59:54', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-19T06:04:47.491 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-19T06:04:47.499 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-19T06:04:47.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-03-19T06:04:47.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-03-19T06:04:47.658 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:47.658 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T06:04:47.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T06:04:47.717 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-19 06:04:33.803630896 +0000 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-19 05:54:39.754904139 +0000 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-19 05:54:39.754904139 +0000 2024-03-19T06:04:47.774 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-19 05:54:39.754904139 +0000 2024-03-19T06:04:47.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T06:04:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-19T06:04:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-19T06:04:47.870 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000249838 s, 2.0 MB/s 2024-03-19T06:04:47.874 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T06:04:47.933 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-03-19T06:04:47.985 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-19 06:04:33.804630886 +0000 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-19 05:54:40.340897805 +0000 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-19 05:54:40.340897805 +0000 2024-03-19T06:04:47.986 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-19 05:54:40.340897805 +0000 2024-03-19T06:04:47.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T06:04:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-19T06:04:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-19T06:04:48.082 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000236016 s, 2.2 MB/s 2024-03-19T06:04:48.087 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T06:04:48.146 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-19 06:04:33.805630875 +0000 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-19 05:54:40.906891682 +0000 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-19 05:54:40.906891682 +0000 2024-03-19T06:04:48.199 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-19 05:54:40.906891682 +0000 2024-03-19T06:04:48.200 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T06:04:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-19T06:04:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-19T06:04:48.291 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000233766 s, 2.2 MB/s 2024-03-19T06:04:48.296 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T06:04:48.356 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-03-19T06:04:48.409 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T06:04:48.409 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:48.409 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-19T06:04:48.409 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:48.410 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:48.410 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-19 06:04:33.805630875 +0000 2024-03-19T06:04:48.410 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-19 05:54:41.499885267 +0000 2024-03-19T06:04:48.410 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-19 05:54:41.499885267 +0000 2024-03-19T06:04:48.410 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-19 05:54:41.499885267 +0000 2024-03-19T06:04:48.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T06:04:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-19T06:04:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-19T06:04:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000264963 s, 1.9 MB/s 2024-03-19T06:04:48.506 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T06:04:48.566 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:48.566 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:48.566 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-03-19T06:04:48.618 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-19T06:04:48.618 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-19 06:04:17.248679552 +0000 2024-03-19T06:04:48.659 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-19 05:54:25.752550653 +0000 2024-03-19T06:04:48.660 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-19 05:54:25.752550653 +0000 2024-03-19T06:04:48.660 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-19 05:54:25.752550653 +0000 2024-03-19T06:04:48.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-19T06:04:48.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-19T06:04:48.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-19T06:04:48.776 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00029435 s, 1.7 MB/s 2024-03-19T06:04:48.778 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-19T06:04:48.828 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-19 06:04:17.248679552 +0000 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-19 05:54:26.322540368 +0000 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-19 05:54:26.322540368 +0000 2024-03-19T06:04:48.870 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-19 05:54:26.322540368 +0000 2024-03-19T06:04:48.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-19T06:04:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-19T06:04:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-19T06:04:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000335151 s, 1.5 MB/s 2024-03-19T06:04:48.997 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-19T06:04:49.043 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:49.088 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-19 06:04:17.249679534 +0000 2024-03-19T06:04:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-19 05:54:26.876530372 +0000 2024-03-19T06:04:49.089 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-19 05:54:26.876530372 +0000 2024-03-19T06:04:49.089 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-19 05:54:26.876530372 +0000 2024-03-19T06:04:49.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-19T06:04:49.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-19T06:04:49.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-19T06:04:49.212 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00030347 s, 1.7 MB/s 2024-03-19T06:04:49.215 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-19T06:04:49.261 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-19 06:04:17.250679516 +0000 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-19 05:54:27.446520087 +0000 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-19 05:54:27.446520087 +0000 2024-03-19T06:04:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-19 05:54:27.446520087 +0000 2024-03-19T06:04:49.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-19T06:04:49.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-19T06:04:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-19T06:04:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000331637 s, 1.5 MB/s 2024-03-19T06:04:49.442 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-19T06:04:49.493 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:49.493 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-19T06:04:49.493 INFO:tasks.ceph:Generating config... 2024-03-19T06:04:49.494 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-19T06:04:49.494 INFO:tasks.ceph:[client] debug client = 20 2024-03-19T06:04:49.494 INFO:tasks.ceph:[client] debug ms = 1 2024-03-19T06:04:49.494 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-19T06:04:49.494 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-19T06:04:49.494 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-03-19T06:04:49.494 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-03-19T06:04:49.495 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-19T06:04:49.495 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-19T06:04:49.496 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-19T06:04:49.496 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-19T06:04:49.496 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-19T06:04:49.496 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-19T06:04:49.496 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-19T06:04:49.496 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-19T06:04:49.497 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-19T06:04:49.497 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-19T06:04:49.497 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-19T06:04:49.497 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-19T06:04:49.497 INFO:tasks.ceph:Setting up mon.a... 2024-03-19T06:04:49.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-19T06:04:49.636 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-03-19T06:04:49.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-19T06:04:49.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:04:49.888 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]')] 2024-03-19T06:04:49.888 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-19T06:04:49.889 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:49.889 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-19T06:04:49.944 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:50.104 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid b76b09f0-0b97-45ba-8841-90df0fadb075 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:fsid b76b09f0-0b97-45ba-8841-90df0fadb075 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-03-19T06:04:50.113971+0000 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-03-19T06:04:50.113971+0000 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-03-19T06:04:50.105 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-19T06:04:50.108 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-19T06:04:50.159 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b76b09f0-0b97-45ba-8841-90df0fadb075... 2024-03-19T06:04:50.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-19T06:04:50.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-19T06:04:50.338 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-03-19T06:04:50.338 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-03-19T06:04:50.338 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-19T06:04:50.338 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.339 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-19T06:04:50.340 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mds beacon grace = 60 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: mds heartbeat grace = 60 2024-03-19T06:04:50.341 INFO:teuthology.orchestra.run.smithi017.stdout: osd heartbeat grace = 60 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = b76b09f0-0b97-45ba-8841-90df0fadb075 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-03-19T06:04:50.342 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-03-19T06:04:50.343 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 20 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 20 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 10 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: osd fast shutdown = False 2024-03-19T06:04:50.344 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-03-19T06:04:50.345 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-03-19T06:04:50.346 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: mon op complaint time = 120 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd crush smoke test = False 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-19T06:04:50.347 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 600 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-03-19T06:04:50.348 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds = 20 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds balancer = 20 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug frag = True 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = True 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: mds op complaint time = 180 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: mds valgrind exit = True 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = True 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-19T06:04:50.349 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-03-19T06:04:50.350 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-19T06:04:50.351 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.17,172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790]" 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mds beacon grace = 60 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: mds heartbeat grace = 60 2024-03-19T06:04:50.352 INFO:teuthology.orchestra.run.smithi153.stdout: osd heartbeat grace = 60 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = b76b09f0-0b97-45ba-8841-90df0fadb075 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-03-19T06:04:50.353 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.354 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 20 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 20 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 10 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: osd fast shutdown = False 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-03-19T06:04:50.355 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-03-19T06:04:50.356 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-19T06:04:50.357 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd crush smoke test = False 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2024-03-19T06:04:50.358 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.e] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.f] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2024-03-19T06:04:50.359 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds balancer = 20 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: mds valgrind exit = True 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2024-03-19T06:04:50.360 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2024-03-19T06:04:50.385 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-19T06:04:50.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-19T06:04:50.539 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-19T06:04:50.539 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:50.539 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-19T06:04:50.592 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:50.592 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-19T06:04:50.647 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:04:50.647 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:50.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-19T06:04:50.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:04:50.806 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:04:50.807 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:50.906 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:04:50.906 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:50.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-19T06:04:50.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-19T06:04:51.057 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:04:51.057 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:51.154 INFO:tasks.ceph:Setting up mon nodes... 2024-03-19T06:04:51.154 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-19T06:04:51.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-19T06:04:51.353 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-19T06:04:51.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-19T06:04:51.571 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-19T06:04:51.582 INFO:tasks.ceph:Setting up mds nodes... 2024-03-19T06:04:51.582 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-19T06:04:51.778 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-19T06:04:51.788 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-19T06:04:51.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-19T06:04:52.072 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-19T06:04:52.081 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-19T06:04:52.183 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-19T06:04:52.375 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-19T06:04:52.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-19T06:04:52.486 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-19T06:04:52.672 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-19T06:04:52.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-19T06:04:52.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-19T06:04:52.952 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-19T06:04:52.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-19T06:04:53.053 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-19T06:04:53.230 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-19T06:04:53.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-19T06:04:53.335 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-19T06:04:53.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-19T06:04:53.477 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-19T06:04:53.534 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-19T06:04:53.534 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-19T06:04:53.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-19T06:04:53.638 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:53.638 INFO:tasks.ceph:role: osd.0 2024-03-19T06:04:53.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:04:53.639 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-19T06:04:53.732 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:04:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:04:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:04:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:04:53.732 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:04:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:04:53.733 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:04:53.733 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:04:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:04:53.733 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:04:53.766 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-19T06:04:53.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-19T06:04:53.772 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-19T06:04:53.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-19T06:04:53.969 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-19T06:04:54.051 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:54.051 INFO:tasks.ceph:role: osd.1 2024-03-19T06:04:54.052 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:04:54.052 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-19T06:04:54.139 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:04:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:04:54.139 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:04:54.140 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:04:54.172 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-19T06:04:54.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-19T06:04:54.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-19T06:04:54.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-19T06:04:54.380 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-19T06:04:54.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:54.472 INFO:tasks.ceph:role: osd.2 2024-03-19T06:04:54.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:04:54.472 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:04:54.568 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:04:54.569 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:04:54.569 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:04:54.602 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-19T06:04:54.608 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-19T06:04:54.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-19T06:04:54.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-19T06:04:54.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-19T06:04:54.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-19T06:04:54.893 INFO:tasks.ceph:role: osd.3 2024-03-19T06:04:54.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:04:54.893 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-19T06:04:54.991 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:04:54.991 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:04:54.991 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:04:54.991 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:04:54.991 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:04:54.992 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:04:54.992 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:04:54.992 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:04:54.992 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:04:54.992 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:04:55.024 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-19T06:04:55.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-19T06:04:55.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-19T06:04:55.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-19T06:04:55.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.405+0000 7fbb1f40f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-19T06:04:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.406+0000 7fbb1f40f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-19T06:04:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.406+0000 7fbb1f40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:04:55.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.406+0000 7fbb1f40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:04:55.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.406+0000 7fbb1f40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-19T06:04:55.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:55.409+0000 7fbb1f40f640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-19T06:04:58.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-19T06:04:58.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:04:58.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.836+0000 7fb53e9ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-19T06:04:58.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.836+0000 7fb53e9ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-19T06:04:58.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.836+0000 7fb53e9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:04:58.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.836+0000 7fb53e9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:04:58.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.836+0000 7fb53e9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-19T06:04:58.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:04:58.839+0000 7fb53e9ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-19T06:05:01.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-19T06:05:01.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.015+0000 7f104288b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-19T06:05:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.016+0000 7f104288b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-19T06:05:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.016+0000 7f104288b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:05:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.016+0000 7f104288b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:05:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.016+0000 7f104288b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-19T06:05:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:02.018+0000 7f104288b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-19T06:05:05.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-19T06:05:05.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:05.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.441+0000 7f94e0048640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-19T06:05:05.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.441+0000 7f94e0048640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-19T06:05:05.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.441+0000 7f94e0048640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:05:05.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.441+0000 7f94e0048640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:05:05.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.441+0000 7f94e0048640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-19T06:05:05.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:05.444+0000 7f94e0048640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-19T06:05:08.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-19T06:05:08.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-19T06:05:08.829 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:05:08.829 INFO:tasks.ceph:role: osd.4 2024-03-19T06:05:08.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:05:08.829 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-19T06:05:08.930 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:05:08.930 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:05:08.931 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:05:09.448 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-19T06:05:09.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-19T06:05:09.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-19T06:05:09.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-19T06:05:09.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-19T06:05:09.840 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:05:09.840 INFO:tasks.ceph:role: osd.5 2024-03-19T06:05:09.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:05:09.840 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-19T06:05:09.937 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:05:09.938 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:05:10.440 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-19T06:05:10.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-19T06:05:10.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-19T06:05:10.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-19T06:05:10.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-19T06:05:10.772 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:05:10.772 INFO:tasks.ceph:role: osd.6 2024-03-19T06:05:10.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:05:10.773 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-19T06:05:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:05:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:05:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:05:10.869 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:05:10.869 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:05:10.870 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:05:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:05:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:05:10.870 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:05:10.870 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:05:11.395 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-19T06:05:11.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-19T06:05:11.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-19T06:05:11.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-19T06:05:11.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-19T06:05:11.794 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-19T06:05:11.795 INFO:tasks.ceph:role: osd.7 2024-03-19T06:05:11.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:05:11.795 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-19T06:05:11.892 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-19T06:05:11.892 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-19T06:05:11.892 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-19T06:05:11.892 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-19T06:05:11.892 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-19T06:05:11.893 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-03-19T06:05:11.893 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-19T06:05:11.893 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-19T06:05:11.893 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-19T06:05:11.893 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-19T06:05:12.382 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-03-19T06:05:12.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-03-19T06:05:12.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-19T06:05:12.545 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-19T06:05:12.648 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:12.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.817+0000 7f4cf3e12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-19T06:05:12.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.819+0000 7f4cf3e12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-19T06:05:12.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.819+0000 7f4cf3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:05:12.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.819+0000 7f4cf3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:05:12.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.819+0000 7f4cf3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-19T06:05:12.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:12.828+0000 7f4cf3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-19T06:05:15.765 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-19T06:05:15.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:16.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.012+0000 7f7fb0466640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-19T06:05:16.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.012+0000 7f7fb0466640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-19T06:05:16.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.012+0000 7f7fb0466640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:05:16.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.012+0000 7f7fb0466640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:05:16.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.012+0000 7f7fb0466640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-19T06:05:16.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:16.015+0000 7f7fb0466640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-19T06:05:17.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:05:17.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:05:18.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-19T06:05:19.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.171+0000 7f8ca7a0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-19T06:05:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.171+0000 7f8ca7a0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-19T06:05:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.171+0000 7f8ca7a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:05:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.171+0000 7f8ca7a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:05:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.171+0000 7f8ca7a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-19T06:05:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:19.173+0000 7f8ca7a0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-19T06:05:22.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-19T06:05:22.170 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:22.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.310+0000 7f9a5680d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-19T06:05:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.311+0000 7f9a5680d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-19T06:05:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.311+0000 7f9a5680d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:05:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.311+0000 7f9a5680d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:05:22.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.311+0000 7f9a5680d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-19T06:05:22.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:22.313+0000 7f9a5680d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-19T06:05:25.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-19T06:05:25.334 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-19T06:05:25.335 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-19T06:05:25.443 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.443 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-19T06:05:25.545 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-19T06:05:25.643 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-19T06:05:25.740 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-19T06:05:25.841 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-19T06:05:25.937 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:25.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-19T06:05:26.039 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:26.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-19T06:05:26.140 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-19T06:05:26.236 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-19T06:05:26.329 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-19T06:05:26.422 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-19T06:05:26.518 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-19T06:05:26.607 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.607 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-19T06:05:26.702 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-19T06:05:26.793 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:26.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-19T06:05:26.885 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:26.885 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-19T06:05:26.945 INFO:tasks.ceph:Adding keys to all mons... 2024-03-19T06:05:26.945 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-19T06:05:26.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQADK/llF9+bFRAA0uf2UiCHcdyEh1H2R2M7kg== 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQADK/llbTzyLhAACDXo6Ob7ieVBCbNKgWfosA== 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAEK/ll4JrYBBAAkBcRkN4k0V9SID+1UVupNA== 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.e] 2024-03-19T06:05:27.039 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAEK/ll/7rzFhAAAE3PqNZ5MOO4n5+F41fibg== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAHK/llvJo4GBAAvNQJ+eaDae5uOAGKSVhSMw== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAKK/ll9VPjMRAAvxzecJU9xXnb0dKqqxn2pw== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAOK/lliA78ABAAWQLQlLOa/63FiyZFWo7T8A== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQARK/llGfJZGhAAIqZSSYgyO8wA/P2/p4qoAQ== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQADK/llAFSfIhAAao1ZPmRcv18QdJ+COHawnA== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAEK/llgkCfKBAA95Ka4ARMsGUoDc2uc8Ia/w== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAEK/llm8xVORAAyywdH08jVoKmzs/GJwFu3g== 2024-03-19T06:05:27.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.f] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAFK/llvhBUDhAApOnR5hi1Q1OernkQrX3WxQ== 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAYK/lltonIMBAAaA6OZm+uyyiE45dmhcRkSg== 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAcK/llx/7IABAA3mu6ax4fXIt8+4bpUArPgw== 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAfK/ll+X1CChAAAppmFQSgPg67qUR+7cb7gg== 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAiK/llo3iWEhAApm9XClWL6RpWZ24OFymH8Q== 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-03-19T06:05:27.041 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAFK/ll5mkGHRAAii7dKgIuUn5mjsF/r6coew== 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQADK/llF9+bFRAA0uf2UiCHcdyEh1H2R2M7kg== 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQADK/llbTzyLhAACDXo6Ob7ieVBCbNKgWfosA== 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAEK/ll4JrYBBAAkBcRkN4k0V9SID+1UVupNA== 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.e] 2024-03-19T06:05:27.046 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAEK/ll/7rzFhAAAE3PqNZ5MOO4n5+F41fibg== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAHK/llvJo4GBAAvNQJ+eaDae5uOAGKSVhSMw== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAKK/ll9VPjMRAAvxzecJU9xXnb0dKqqxn2pw== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAOK/lliA78ABAAWQLQlLOa/63FiyZFWo7T8A== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQARK/llGfJZGhAAIqZSSYgyO8wA/P2/p4qoAQ== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQADK/llAFSfIhAAao1ZPmRcv18QdJ+COHawnA== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAEK/llgkCfKBAA95Ka4ARMsGUoDc2uc8Ia/w== 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2024-03-19T06:05:27.047 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAEK/llm8xVORAAyywdH08jVoKmzs/GJwFu3g== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.f] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAFK/llvhBUDhAApOnR5hi1Q1OernkQrX3WxQ== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAYK/lltonIMBAAaA6OZm+uyyiE45dmhcRkSg== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAcK/llx/7IABAA3mu6ax4fXIt8+4bpUArPgw== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAfK/ll+X1CChAAAppmFQSgPg67qUR+7cb7gg== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAiK/llo3iWEhAApm9XClWL6RpWZ24OFymH8Q== 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-03-19T06:05:27.048 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAFK/ll5mkGHRAAii7dKgIuUn5mjsF/r6coew== 2024-03-19T06:05:27.050 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:05:27.094 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:05:27.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:27.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:27.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:27.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:27.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.312 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:05:28.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-19T06:05:28.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.633 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.788 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-19T06:05:28.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:28.944 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-19T06:05:29.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:05:29.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-19T06:05:29.688 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-19T06:05:29.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-19T06:05:29.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:05:29.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-19T06:05:30.042 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-19T06:05:30.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:05:30.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-19T06:05:30.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-19T06:05:30.467 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-19T06:05:30.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-19T06:05:30.717 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:30.725 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-19T06:05:30.777 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-19T06:05:30.777 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-19T06:05:30.778 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-19T06:05:30.778 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-03-19T06:05:30.784 INFO:tasks.ceph.mon.a:Started 2024-03-19T06:05:30.784 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-19T06:05:30.784 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-19T06:05:30.784 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-03-19T06:05:30.789 INFO:tasks.ceph.mon.b:Started 2024-03-19T06:05:30.789 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-19T06:05:30.789 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-19T06:05:30.789 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-03-19T06:05:30.794 INFO:tasks.ceph.mon.c:Started 2024-03-19T06:05:30.794 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-19T06:05:30.794 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-19T06:05:30.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-03-19T06:05:30.800 INFO:tasks.ceph.mgr.y:Started 2024-03-19T06:05:30.800 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-19T06:05:30.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-03-19T06:05:30.805 INFO:tasks.ceph.mgr.x:Started 2024-03-19T06:05:30.805 INFO:tasks.ceph:Setting crush tunables to default 2024-03-19T06:05:30.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-03-19T06:05:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.994+0000 7fe740a00640 1 Processor -- start 2024-03-19T06:05:30.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.994+0000 7fe740a00640 1 -- start start 2024-03-19T06:05:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.995+0000 7fe740a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:30.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.995+0000 7fe740a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.995+0000 7fe740a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06bbd0 con 0x7fe73c15a660 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.995+0000 7fe740a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe73c15aa40 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.995+0000 7fe740a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06c190 con 0x7fe73c0b2700 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.996+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe73c15a660 legacy=0x7fe73c0b1fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.996+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 msgr2=0x7fe73c0ca220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.996+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 msgr2=0x7fe73c0ca760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.996+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:30.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:30.996+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:31.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.197+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 msgr2=0x7fe73c0ca760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.197+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe73c15a660 legacy=0x7fe73c0b1fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.197+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 msgr2=0x7fe73c0ca220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.197+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:31.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.197+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.598+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 msgr2=0x7fe73c0ca760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.598+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 msgr2=0x7fe73c0ca220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.598+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe73c15a660 legacy=0x7fe73c0b1fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.598+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:31.598+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:32.399+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 msgr2=0x7fe73c0ca760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:32.399+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 msgr2=0x7fe73c0ca220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:32.399+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe73c15a660 legacy=0x7fe73c0b1fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:32.399+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:32.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:32.399+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 msgr2=0x7fe73c0ca760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe73c0b2700 0x7fe73c0ca760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 msgr2=0x7fe73c0ca220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe73c15aa40 0x7fe73c0ca220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe73c15a660 legacy=0x7fe73c0b1fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06c470 con 0x7fe718006190 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe738a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe7180036c0 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe73a800640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 msgr2=0x7fe718005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe733e00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718006190 legacy=0x7fe718008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:33.996+0000 7fe73a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:34.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.197+0000 7fe733e00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718006190 legacy=0x7fe718008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:34.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.197+0000 7fe73a800640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 msgr2=0x7fe718005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:34.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.197+0000 7fe73a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.597+0000 7fe733e00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718006190 legacy=0x7fe718008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.597+0000 7fe73a800640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 msgr2=0x7fe718005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:34.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:34.597+0000 7fe73a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:35.398+0000 7fe733e00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718006190 legacy=0x7fe718008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:35.398+0000 7fe73a800640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 msgr2=0x7fe718005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:35.398+0000 7fe73a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:36.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 msgr2=0x7fe718005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:36.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe7180036c0 0x7fe718005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:36.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718006190 legacy=0x7fe718008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:36.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe73b200640 1 -- reap_dead start 2024-03-19T06:05:36.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06bbd0 con 0x7fe718009f00 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe71800aa90 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe738a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06c190 con 0x7fe7180087a0 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.995+0000 7fe733e00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 msgr2=0x7fe718005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.996+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.996+0000 7fe73a800640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718009f00 legacy=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.996+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:36.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:36.996+0000 7fe733e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:37.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.197+0000 7fe733e00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 msgr2=0x7fe718005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:37.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.197+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:37.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.197+0000 7fe73a800640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718009f00 legacy=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:37.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.197+0000 7fe733e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:37.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.197+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:37.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.598+0000 7fe733e00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 msgr2=0x7fe718005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:37.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.598+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:37.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.598+0000 7fe733e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:37.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.598+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:37.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:37.598+0000 7fe73a800640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718009f00 legacy=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:38.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:38.399+0000 7fe73b200640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800d0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3301/0 2024-03-19T06:05:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:38.399+0000 7fe733e00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 msgr2=0x7fe718005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.17:3300/0 2024-03-19T06:05:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:38.399+0000 7fe73a800640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718009f00 legacy=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.17:6789/0 2024-03-19T06:05:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:38.399+0000 7fe73b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:38.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:38.399+0000 7fe733e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:38.769 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:00:07.782 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:38.788 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:00:07.801 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:39.019 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:00:08.016 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:39.099 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:00:08.112 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:39.118 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:00:08.131 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:39.358 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:00:08.354 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:05:39.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800d0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800d0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 -- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 msgr2=0x7fe718005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe71800aa90 0x7fe718005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 -- >> v1:172.21.15.17:6789/0 conn(0x7fe718009f00 legacy=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06c470 con 0x7fe71800d660 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe738a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe7180117e0 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:39.996+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.197+0000 7fe733e00640 1 -- >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.153:3300/0 2024-03-19T06:05:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.197+0000 7fe733e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:40.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.197+0000 7fe73a800640 1 -- >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.153:6789/0 2024-03-19T06:05:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.748+0000 7fe73a800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 0x7fe71800da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:52160/0 (socket says 172.21.15.17:52160) 2024-03-19T06:05:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.748+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 learned_addr learned my addr 172.21.15.17:0/250116319 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:05:40.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:40.776+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.070+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-19T06:05:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.070+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-19T06:05:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.070+0000 7fe73a800640 1 --1- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 0x7fe71800da70 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2024-03-19T06:05:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.070+0000 7fe73a800640 1 --1- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 0x7fe71800da70 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2024-03-19T06:05:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.181+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.181+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.181+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:41.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:41.182+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.032+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:42.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.126+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:42.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.126+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:42.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.126+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:42.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.126+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe7180117e0 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 reap_dead start 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06bbd0 con 0x7fe71800d660 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe718014110 2024-03-19T06:05:42.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06c190 con 0x7fe7180087a0 2024-03-19T06:05:42.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:42.999+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:42.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.003+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.007+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.008+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.008+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.008+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.020+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-19T06:05:43.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.020+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.020+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.020+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:43.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.210+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.213+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.213+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.213+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.213+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:43.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.311+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:43.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.381+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:43.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.381+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.381+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.381+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:43.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.639+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.646+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.646+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.646+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.646+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:43.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.784+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.786+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.786+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.786+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:43.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:43.786+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-19T06:05:44.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.453+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:44.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.456+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:44.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.456+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:44.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.456+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:44.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.456+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.608+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.628+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-19T06:05:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.628+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.628+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:44.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:44.628+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-19T06:05:45.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 msgr2=0x7fe71800a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.996+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7180087a0 0x7fe71800a2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 msgr2=0x7fe718016500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.996+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.153:3300/0 conn(0x7fe718014110 0x7fe718016500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.996+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 >> v1:172.21.15.153:6789/0 conn(0x7fe71800d660 legacy=0x7fe71800da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:45.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.997+0000 7fe738a00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:45.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.997+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe718003aa0 con 0x7fe718008ea0 2024-03-19T06:05:45.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:45.997+0000 7fe738a00640 1 -- 172.21.15.17:0/250116319 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe718009990 2024-03-19T06:05:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.301+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:46.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.472+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:05:46.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.472+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:46.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.472+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:46.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.472+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-19T06:05:46.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.807+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:46.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.810+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-19T06:05:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.810+0000 7fe733e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-19T06:05:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.810+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-19T06:05:46.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.810+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-19T06:05:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.987+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227172463 0 0) 0x7fe718003aa0 con 0x7fe718008ea0 2024-03-19T06:05:46.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:46.987+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe720003520 con 0x7fe718008ea0 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758928359 0 0) 0x7fe720003520 con 0x7fe718008ea0 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 msgr2=0x7fe718013bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 --2- 172.21.15.17:0/250116319 >> v2:172.21.15.17:3300/0 conn(0x7fe718009990 0x7fe718013bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe71800d100 con 0x7fe718008ea0 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fe72c004070 con 0x7fe718008ea0 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 >> v1:172.21.15.17:6789/0 conn(0x7fe718008ea0 legacy=0x7fe718009280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe73b200640 1 -- 172.21.15.17:0/250116319 reap_dead start 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 0x7fe720003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06beb0 con 0x7fe720004800 2024-03-19T06:05:47.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72000c140 con 0x7fe7200039b0 2024-03-19T06:05:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.110+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72000c340 con 0x7fe720005210 2024-03-19T06:05:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.112+0000 7fe73b200640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.113+0000 7fe73a800640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 0x7fe720003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.198+0000 7fe733e00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.227+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe720005210 msgr2=0x7fe72000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.227+0000 7fe73a800640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.227+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720004800 msgr2=0x7fe720004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.227+0000 7fe73a800640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.227+0000 7fe73a800640 1 -- 172.21.15.17:0/250116319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720003520 con 0x7fe7200039b0 2024-03-19T06:05:47.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.235+0000 7fe73a800640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 0x7fe720003db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000ea0 tx=0x7fe720005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9470e8142f67f73c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.326+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007c00 con 0x7fe7200039b0 2024-03-19T06:05:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.326+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c030070 con 0x7fe7200039b0 2024-03-19T06:05:47.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.326+0000 7fe739e00640 1 -- 172.21.15.17:0/250116319 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c034410 con 0x7fe7200039b0 2024-03-19T06:05:47.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 -- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 msgr2=0x7fe720003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:47.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 0x7fe720003db0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000ea0 tx=0x7fe720005830 comp rx=0 tx=0).stop 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 -- 172.21.15.17:0/250116319 shutdown_connections 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe720005210 0x7fe72000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720004800 0x7fe720004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 --2- 172.21.15.17:0/250116319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7200039b0 0x7fe720003db0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 -- 172.21.15.17:0/250116319 >> 172.21.15.17:0/250116319 conn(0x7fe73c072360 msgr2=0x7fe73c072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 -- 172.21.15.17:0/250116319 shutdown_connections 2024-03-19T06:05:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.328+0000 7fe740a00640 1 -- 172.21.15.17:0/250116319 wait complete. 2024-03-19T06:05:47.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.334+0000 7fe740a00640 1 Processor -- start 2024-03-19T06:05:47.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.334+0000 7fe740a00640 1 -- start start 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe720004800 0x7fe73c14ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720005210 0x7fe73c1e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06b860 con 0x7fe720005210 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0b3020 con 0x7fe720004800 2024-03-19T06:05:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.336+0000 7fe740a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c06b9e0 con 0x7fe7200039b0 2024-03-19T06:05:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.338+0000 7fe73a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.338+0000 7fe73a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:51882/0 (socket says 172.21.15.17:51882) 2024-03-19T06:05:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.338+0000 7fe73a800640 1 -- 172.21.15.17:0/4254941480 learned_addr learned my addr 172.21.15.17:0/4254941480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:05:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.339+0000 7fe733e00640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe720004800 0x7fe73c14ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.356+0000 7fe73b200640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720005210 0x7fe73c1e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.363+0000 7fe73a800640 1 -- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe720004800 msgr2=0x7fe73c14ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.363+0000 7fe73a800640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe720004800 0x7fe73c14ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.363+0000 7fe73a800640 1 -- 172.21.15.17:0/4254941480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720005210 msgr2=0x7fe73c1e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.363+0000 7fe73a800640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720005210 0x7fe73c1e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:47.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.363+0000 7fe73a800640 1 -- 172.21.15.17:0/4254941480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c15af10 con 0x7fe7200039b0 2024-03-19T06:05:47.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.373+0000 7fe73a800640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000ea0 tx=0x7fe72c0062f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.494+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c043070 con 0x7fe7200039b0 2024-03-19T06:05:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.494+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0349d0 con 0x7fe7200039b0 2024-03-19T06:05:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.494+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007c00 con 0x7fe7200039b0 2024-03-19T06:05:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.494+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c15be40 con 0x7fe7200039b0 2024-03-19T06:05:47.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.494+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c15d550 con 0x7fe7200039b0 2024-03-19T06:05:47.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.496+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c04f050 con 0x7fe7200039b0 2024-03-19T06:05:47.673 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:05:47.680 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:05:47.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.739+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe72c03d040 con 0x7fe7200039b0 2024-03-19T06:05:47.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.749+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe72c03fbb0 con 0x7fe7200039b0 2024-03-19T06:05:47.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.750+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe72c034e00 con 0x7fe7200039b0 2024-03-19T06:05:47.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:47.831+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe73c04f050 con 0x7fe7200039b0 2024-03-19T06:05:48.159 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:48.167+0000 7f6411c46040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-19T06:05:48.180 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:48.187+0000 7fcf17638040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-19T06:05:48.229 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:48.237+0000 7f6411c46040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-19T06:05:48.250 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:48.258+0000 7fcf17638040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-19T06:05:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.330+0000 7fe732a00640 1 -- 172.21.15.17:0/4254941480 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe72c03fdb0 con 0x7fe7200039b0 2024-03-19T06:05:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 msgr2=0x7fe73c14c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe72c000ea0 tx=0x7fe72c0062f0 comp rx=0 tx=0).stop 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 shutdown_connections 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe720005210 0x7fe73c1e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe720004800 0x7fe73c14ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 --2- 172.21.15.17:0/4254941480 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe7200039b0 0x7fe73c14c990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.332+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 >> 172.21.15.17:0/4254941480 conn(0x7fe73c072360 msgr2=0x7fe73c153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.333+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 shutdown_connections 2024-03-19T06:05:48.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:48.333+0000 7fe740a00640 1 -- 172.21.15.17:0/4254941480 wait complete. 2024-03-19T06:05:48.349 INFO:tasks.ceph:check_enable_crimson: False 2024-03-19T06:05:48.350 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-19T06:05:48.350 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:48.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-19T06:05:48.494 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:48.494 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-19T06:05:48.580 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:48.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-19T06:05:48.713 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:05:48.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-19T06:05:48.802 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:48.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-19T06:05:48.885 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:48.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-19T06:05:48.916 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:48.924+0000 7fcf17638040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-19T06:05:48.951 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:48.960+0000 7f6411c46040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-19T06:05:48.983 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:48.991+0000 7fcf17638040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-19T06:05:49.012 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:49.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-19T06:05:49.023 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.032+0000 7f6411c46040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-19T06:05:49.036 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.044+0000 7fcf17638040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-19T06:05:49.081 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.089+0000 7f6411c46040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-19T06:05:49.101 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.109+0000 7fcf17638040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-19T06:05:49.106 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-19T06:05:49.107 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-19T06:05:49.153 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.161+0000 7fcf17638040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-19T06:05:49.155 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.159+0000 7f6411c46040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-19T06:05:49.206 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.214+0000 7f6411c46040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-19T06:05:49.232 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new da7555cf-85e9-4418-bee6-b02e1fb27a27 0 2024-03-19T06:05:49.290 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.297+0000 7fcf17638040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-19T06:05:49.344 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.352+0000 7f6411c46040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-19T06:05:49.373 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.381+0000 7fcf17638040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:49.429 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.437+0000 7f6411c46040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:49.429 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.437+0000 7fcf17638040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-19T06:05:49.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.474+0000 7f177b200640 1 Processor -- start 2024-03-19T06:05:49.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.475+0000 7f177b200640 1 -- start start 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f17740ca4e0 0x7f17740cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f177406c170 0x7f1774153920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17740c4a20 con 0x7f17740ca4e0 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177406b4c0 con 0x7f177406c170 2024-03-19T06:05:49.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.476+0000 7f177b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177415a180 con 0x7f17740ca8c0 2024-03-19T06:05:49.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.477+0000 7f1779400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.477+0000 7f177a800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f177406c170 0x7f1774153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.477+0000 7f1779400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:40612/0 (socket says 172.21.15.153:40612) 2024-03-19T06:05:49.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.477+0000 7f1779400640 1 -- 172.21.15.153:0/727427237 learned_addr learned my addr 172.21.15.153:0/727427237 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:49.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.478+0000 7f1779e00640 1 --2- 172.21.15.153:0/727427237 >> v2:172.21.15.17:3300/0 conn(0x7f17740ca4e0 0x7f17740cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.480+0000 7f1779400640 1 -- 172.21.15.153:0/727427237 >> v2:172.21.15.153:3300/0 conn(0x7f177406c170 msgr2=0x7f1774153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.480+0000 7f1779400640 1 --2- 172.21.15.153:0/727427237 >> v2:172.21.15.153:3300/0 conn(0x7f177406c170 0x7f1774153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.480+0000 7f1779400640 1 -- 172.21.15.153:0/727427237 >> v2:172.21.15.17:3300/0 conn(0x7f17740ca4e0 msgr2=0x7f17740cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.480+0000 7f1779400640 1 --2- 172.21.15.153:0/727427237 >> v2:172.21.15.17:3300/0 conn(0x7f17740ca4e0 0x7f17740cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.480+0000 7f1779400640 1 -- 172.21.15.153:0/727427237 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177415a460 con 0x7f17740ca8c0 2024-03-19T06:05:49.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.482+0000 7f1779400640 1 --2- 172.21.15.153:0/727427237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700f95b85e22fc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:49.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.487+0000 7f1778a00640 1 -- 172.21.15.153:0/727427237 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764034070 con 0x7f17740ca8c0 2024-03-19T06:05:49.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.487+0000 7f1778a00640 1 -- 172.21.15.153:0/727427237 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764030840 con 0x7f17740ca8c0 2024-03-19T06:05:49.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.487+0000 7f1778a00640 1 -- 172.21.15.153:0/727427237 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764030c10 con 0x7f17740ca8c0 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 -- 172.21.15.153:0/727427237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 msgr2=0x7f177406bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 --2- 172.21.15.153:0/727427237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1764009870 tx=0x7f176402b980 comp rx=0 tx=0).stop 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 -- 172.21.15.153:0/727427237 shutdown_connections 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 --2- 172.21.15.153:0/727427237 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f17740ca8c0 0x7f177406bc30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 --2- 172.21.15.153:0/727427237 >> v2:172.21.15.153:3300/0 conn(0x7f177406c170 0x7f1774153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 --2- 172.21.15.153:0/727427237 >> v2:172.21.15.17:3300/0 conn(0x7f17740ca4e0 0x7f17740cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 -- 172.21.15.153:0/727427237 >> 172.21.15.153:0/727427237 conn(0x7f1774072540 msgr2=0x7f1774072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 -- 172.21.15.153:0/727427237 shutdown_connections 2024-03-19T06:05:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.488+0000 7f177b200640 1 -- 172.21.15.153:0/727427237 wait complete. 2024-03-19T06:05:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.490+0000 7f177b200640 1 Processor -- start 2024-03-19T06:05:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.490+0000 7f177b200640 1 -- start start 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.490+0000 7f177b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f177b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17740ca4e0 0x7f177414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f177b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17740ca8c0 0x7f17740cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f177b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177406b710 con 0x7f17740ca8c0 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f177b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177415aa20 con 0x7f17740ca4e0 2024-03-19T06:05:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f177b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740cbb70 con 0x7f177406c170 2024-03-19T06:05:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f1779e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.491+0000 7f1779400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17740ca4e0 0x7f177414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.492+0000 7f1779e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:40614/0 (socket says 172.21.15.153:40614) 2024-03-19T06:05:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.492+0000 7f1779e00640 1 -- 172.21.15.153:0/2691217623 learned_addr learned my addr 172.21.15.153:0/2691217623 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.492+0000 7f177a800640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17740ca8c0 0x7f17740cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f1779e00640 1 -- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17740ca4e0 msgr2=0x7f177414f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f1779e00640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17740ca4e0 0x7f177414f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f1779e00640 1 -- 172.21.15.153:0/2691217623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17740ca8c0 msgr2=0x7f17740cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f1779e00640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17740ca8c0 0x7f17740cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f1779e00640 1 -- 172.21.15.153:0/2691217623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740cd5a0 con 0x7f177406c170 2024-03-19T06:05:49.488 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.496+0000 7f6411c46040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-19T06:05:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.498+0000 7f1779e00640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f176800d830 tx=0x7f176800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:49.494 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.501+0000 7fcf17638040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-19T06:05:49.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.502+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176800b6c0 con 0x7f177406c170 2024-03-19T06:05:49.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.502+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768019070 con 0x7f177406c170 2024-03-19T06:05:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.502+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176800ba80 con 0x7f177406c170 2024-03-19T06:05:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.502+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1774157140 con 0x7f177406c170 2024-03-19T06:05:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.503+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17740c6710 con 0x7f177406c170 2024-03-19T06:05:49.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.504+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177404f050 con 0x7f177406c170 2024-03-19T06:05:49.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.507+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f176801e460 con 0x7f177406c170 2024-03-19T06:05:49.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.507+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1768028610 con 0x7f177406c170 2024-03-19T06:05:49.551 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.560+0000 7f6411c46040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-19T06:05:49.552 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:49.560+0000 7fcf17638040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-19T06:05:49.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.612+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1768028860 con 0x7f177406c170 2024-03-19T06:05:49.609 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:49.617+0000 7f6411c46040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-19T06:05:49.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:49.694+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "da7555cf-85e9-4418-bee6-b02e1fb27a27", "id": 0} v 0) v1 -- 0x7f17740c42b0 con 0x7f177406c170 2024-03-19T06:05:50.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.009+0000 7f176e000640 1 -- 172.21.15.153:0/2691217623 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da7555cf-85e9-4418-bee6-b02e1fb27a27", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1768028b10 con 0x7f177406c170 2024-03-19T06:05:50.000 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 msgr2=0x7f17741f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f176800d830 tx=0x7f176800dcf0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 shutdown_connections 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17740ca8c0 0x7f17740cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17740ca4e0 0x7f177414f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 --2- 172.21.15.153:0/2691217623 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f177406c170 0x7f17741f0520 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.011+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 >> 172.21.15.153:0/2691217623 conn(0x7f1774072540 msgr2=0x7f17741599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.012+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 shutdown_connections 2024-03-19T06:05:50.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.012+0000 7f177b200640 1 -- 172.21.15.153:0/2691217623 wait complete. 2024-03-19T06:05:50.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 2e7fbcf4-0887-438f-8d45-d901f6325e42 1 2024-03-19T06:05:50.033 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.041+0000 7fcf17638040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-19T06:05:50.086 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.096+0000 7f6411c46040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-19T06:05:50.205 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.213+0000 7fcf17638040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-19T06:05:50.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.220+0000 7f3cf7000640 1 Processor -- start 2024-03-19T06:05:50.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.220+0000 7f3cf7000640 1 -- start start 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.221+0000 7f3cf7000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3cf00ca8c0 0x7f3cf006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.221+0000 7f3cf7000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3cf006c170 0x7f3cf0153920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.221+0000 7f3cf7000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf015a180 con 0x7f3cf00ca4e0 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.221+0000 7f3cf7000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf00c4a20 con 0x7f3cf00ca8c0 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.221+0000 7f3cf7000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf006b4c0 con 0x7f3cf006c170 2024-03-19T06:05:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.222+0000 7f3cf6600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3cf006c170 0x7f3cf0153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.223+0000 7f3cf5c00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3cf00ca4e0 0x7f3cf00cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52920/0 (socket says 172.21.15.153:52920) 2024-03-19T06:05:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.223+0000 7f3cf5c00640 1 -- 172.21.15.153:0/2108843473 learned_addr learned my addr 172.21.15.153:0/2108843473 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-19T06:05:50.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.223+0000 7f3cf5200640 1 --2- 172.21.15.153:0/2108843473 >> v2:172.21.15.17:3300/0 conn(0x7f3cf00ca8c0 0x7f3cf006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:50.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.226+0000 7f3cf6600640 1 -- 172.21.15.153:0/2108843473 >> v2:172.21.15.17:3300/0 conn(0x7f3cf00ca8c0 msgr2=0x7f3cf006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:50.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.226+0000 7f3cf6600640 1 --2- 172.21.15.153:0/2108843473 >> v2:172.21.15.17:3300/0 conn(0x7f3cf00ca8c0 0x7f3cf006bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.226+0000 7f3cf6600640 1 -- 172.21.15.153:0/2108843473 >> v1:172.21.15.153:6789/0 conn(0x7f3cf00ca4e0 legacy=0x7f3cf00cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.226+0000 7f3cf6600640 1 -- 172.21.15.153:0/2108843473 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf015a460 con 0x7f3cf006c170 2024-03-19T06:05:50.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.241+0000 7f3cf6600640 1 --2- 172.21.15.153:0/2108843473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf0153920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00c6490 tx=0x7f3ce802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a6ad34c0d01b730 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:50.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.251+0000 7f3cefe00640 1 -- 172.21.15.153:0/2108843473 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8039070 con 0x7f3cf006c170 2024-03-19T06:05:50.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.251+0000 7f3cefe00640 1 -- 172.21.15.153:0/2108843473 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce802cd00 con 0x7f3cf006c170 2024-03-19T06:05:50.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.251+0000 7f3cefe00640 1 -- 172.21.15.153:0/2108843473 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8034660 con 0x7f3cf006c170 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 -- 172.21.15.153:0/2108843473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 msgr2=0x7f3cf0153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 --2- 172.21.15.153:0/2108843473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf0153920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00c6490 tx=0x7f3ce802bf50 comp rx=0 tx=0).stop 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 -- 172.21.15.153:0/2108843473 shutdown_connections 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 --2- 172.21.15.153:0/2108843473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf0153920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 --2- 172.21.15.153:0/2108843473 >> v2:172.21.15.17:3300/0 conn(0x7f3cf00ca8c0 0x7f3cf006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 -- 172.21.15.153:0/2108843473 >> 172.21.15.153:0/2108843473 conn(0x7f3cf0072540 msgr2=0x7f3cf0072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 -- 172.21.15.153:0/2108843473 shutdown_connections 2024-03-19T06:05:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.252+0000 7f3cf7000640 1 -- 172.21.15.153:0/2108843473 wait complete. 2024-03-19T06:05:50.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.255+0000 7f3cf7000640 1 Processor -- start 2024-03-19T06:05:50.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.255+0000 7f3cf7000640 1 -- start start 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cf00ca4e0 0x7f3cf01f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cf00ca8c0 0x7f3cf01f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf006b710 con 0x7f3cf00ca8c0 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf015aa20 con 0x7f3cf006c170 2024-03-19T06:05:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf7000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00c44d0 con 0x7f3cf00ca4e0 2024-03-19T06:05:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:50.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.257+0000 7f3cf5200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cf00ca4e0 0x7f3cf01f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:50.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.258+0000 7f3cf5c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41134/0 (socket says 172.21.15.153:41134) 2024-03-19T06:05:50.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.258+0000 7f3cf5c00640 1 -- 172.21.15.153:0/1258040170 learned_addr learned my addr 172.21.15.153:0/1258040170 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:50.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.259+0000 7f3cf6600640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cf00ca8c0 0x7f3cf01f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:50.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.264+0000 7f3cf5c00640 1 -- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cf00ca4e0 msgr2=0x7f3cf01f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.264+0000 7f3cf5c00640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cf00ca4e0 0x7f3cf01f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.264+0000 7f3cf5c00640 1 -- 172.21.15.153:0/1258040170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cf00ca8c0 msgr2=0x7f3cf01f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.264+0000 7f3cf5c00640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cf00ca8c0 0x7f3cf01f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.264+0000 7f3cf5c00640 1 -- 172.21.15.153:0/1258040170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf014a300 con 0x7f3cf006c170 2024-03-19T06:05:50.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.266+0000 7f3cf5c00640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400c400 tx=0x7f3ce400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:50.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.269+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4017070 con 0x7f3cf006c170 2024-03-19T06:05:50.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.269+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf0154710 con 0x7f3cf006c170 2024-03-19T06:05:50.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.269+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf0154cd0 con 0x7f3cf006c170 2024-03-19T06:05:50.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.271+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf004f050 con 0x7f3cf006c170 2024-03-19T06:05:50.264 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.274+0000 7f6411c46040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-19T06:05:50.356 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.363+0000 7fcf17638040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-19T06:05:50.400 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.410+0000 7f6411c46040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-19T06:05:50.411 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.419+0000 7fcf17638040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-19T06:05:50.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.460+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce4005ce0 con 0x7f3cf006c170 2024-03-19T06:05:50.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.460+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4021060 con 0x7f3cf006c170 2024-03-19T06:05:50.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.460+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3ce401a070 con 0x7f3cf006c170 2024-03-19T06:05:50.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.460+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3ce4012400 con 0x7f3cf006c170 2024-03-19T06:05:50.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.461+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3ce4012710 con 0x7f3cf006c170 2024-03-19T06:05:50.455 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.465+0000 7f6411c46040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-19T06:05:50.544 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.552+0000 7fcf17638040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:50.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.561+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e7fbcf4-0887-438f-8d45-d901f6325e42", "id": 1} v 0) v1 -- 0x7f3cf00c42b0 con 0x7f3cf006c170 2024-03-19T06:05:50.588 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.598+0000 7f6411c46040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:50.661 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.668+0000 7fcf17638040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-19T06:05:50.703 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.713+0000 7f6411c46040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-19T06:05:50.854 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.861+0000 7fcf17638040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:50.893 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.903+0000 7f6411c46040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:50.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.912+0000 7f3ced600640 1 -- 172.21.15.153:0/1258040170 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e7fbcf4-0887-438f-8d45-d901f6325e42", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3ce4007570 con 0x7f3cf006c170 2024-03-19T06:05:50.903 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 msgr2=0x7f3cf014ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400c400 tx=0x7f3ce400c8c0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 shutdown_connections 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cf00ca8c0 0x7f3cf01f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cf00ca4e0 0x7f3cf01f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 --2- 172.21.15.153:0/1258040170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cf006c170 0x7f3cf014ade0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 >> 172.21.15.153:0/1258040170 conn(0x7f3cf0072540 msgr2=0x7f3cf014cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 shutdown_connections 2024-03-19T06:05:50.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:50.914+0000 7f3cf7000640 1 -- 172.21.15.153:0/1258040170 wait complete. 2024-03-19T06:05:50.906 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:50.913+0000 7fcf17638040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:50.925 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new ea39ea9b-041e-44b6-a3a6-a64d65b66184 2 2024-03-19T06:05:50.950 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:50.960+0000 7f6411c46040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:51.090 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:51.098+0000 7fcf17638040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-19T06:05:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.120+0000 7f89d0c00640 1 Processor -- start 2024-03-19T06:05:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.120+0000 7f89d0c00640 1 -- start start 2024-03-19T06:05:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.122+0000 7f89d0c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.122+0000 7f89d0c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89cc0cb240 0x7f89cc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.122+0000 7f89d0c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0cbbb0 con 0x7f89cc15de20 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.122+0000 7f89d0c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0ca330 con 0x7f89cc0cb240 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.122+0000 7f89d0c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc15a130 con 0x7f89cc154220 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.123+0000 7f89c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.123+0000 7f89c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:40632/0 (socket says 172.21.15.153:40632) 2024-03-19T06:05:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.123+0000 7f89c9e00640 1 -- 172.21.15.153:0/2634206531 learned_addr learned my addr 172.21.15.153:0/2634206531 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:51.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.127+0000 7f89c9e00640 1 -- 172.21.15.153:0/2634206531 >> v2:172.21.15.17:3300/0 conn(0x7f89cc0cb240 msgr2=0x7f89cc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.127+0000 7f89c9e00640 1 --2- 172.21.15.153:0/2634206531 >> v2:172.21.15.17:3300/0 conn(0x7f89cc0cb240 0x7f89cc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.127+0000 7f89c9e00640 1 -- 172.21.15.153:0/2634206531 >> v1:172.21.15.17:6789/0 conn(0x7f89cc15de20 legacy=0x7f89cc0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.127+0000 7f89c9e00640 1 -- 172.21.15.153:0/2634206531 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc15a410 con 0x7f89cc154220 2024-03-19T06:05:51.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.130+0000 7f89c9e00640 1 --2- 172.21.15.153:0/2634206531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790405d08a252425 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:51.137 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:51.146+0000 7f6411c46040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-19T06:05:51.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.177+0000 7f89c8a00640 1 -- 172.21.15.153:0/2634206531 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc034070 con 0x7f89cc154220 2024-03-19T06:05:51.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.177+0000 7f89c8a00640 1 -- 172.21.15.153:0/2634206531 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc030840 con 0x7f89cc154220 2024-03-19T06:05:51.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.177+0000 7f89c8a00640 1 -- 172.21.15.153:0/2634206531 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc030c10 con 0x7f89cc154220 2024-03-19T06:05:51.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 -- 172.21.15.153:0/2634206531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 msgr2=0x7f89cc0ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2634206531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc02b980 comp rx=0 tx=0).stop 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 -- 172.21.15.153:0/2634206531 shutdown_connections 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2634206531 >> v2:172.21.15.17:3300/0 conn(0x7f89cc0cb240 0x7f89cc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2634206531 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc154220 0x7f89cc0ca560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 -- 172.21.15.153:0/2634206531 >> 172.21.15.153:0/2634206531 conn(0x7f89cc06c170 msgr2=0x7f89cc06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 -- 172.21.15.153:0/2634206531 shutdown_connections 2024-03-19T06:05:51.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.178+0000 7f89d0c00640 1 -- 172.21.15.153:0/2634206531 wait complete. 2024-03-19T06:05:51.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.181+0000 7f89d0c00640 1 Processor -- start 2024-03-19T06:05:51.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.181+0000 7f89d0c00640 1 -- start start 2024-03-19T06:05:51.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89cc154220 0x7f89cc0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc15de20 0x7f89cc0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc15acb0 con 0x7f89cc15de20 2024-03-19T06:05:51.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc15a9d0 con 0x7f89cc154220 2024-03-19T06:05:51.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.183+0000 7f89d0c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0cad20 con 0x7f89cc0cb240 2024-03-19T06:05:51.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.184+0000 7f89c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.184+0000 7f89c9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89cc154220 0x7f89cc0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.184+0000 7f89c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:40634/0 (socket says 172.21.15.153:40634) 2024-03-19T06:05:51.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.184+0000 7f89c9e00640 1 -- 172.21.15.153:0/2781589462 learned_addr learned my addr 172.21.15.153:0/2781589462 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:51.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.188+0000 7f89c9e00640 1 -- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89cc154220 msgr2=0x7f89cc0c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.188+0000 7f89c9e00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89cc154220 0x7f89cc0c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.188+0000 7f89c9e00640 1 -- 172.21.15.153:0/2781589462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc15de20 msgr2=0x7f89cc0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.188+0000 7f89c9e00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc15de20 0x7f89cc0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.188+0000 7f89c9e00640 1 -- 172.21.15.153:0/2781589462 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc1e5810 con 0x7f89cc0cb240 2024-03-19T06:05:51.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.190+0000 7f89c9e00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009990 tx=0x7f89bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:51.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.195+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc034040 con 0x7f89cc0cb240 2024-03-19T06:05:51.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.195+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc0433f0 con 0x7f89cc0cb240 2024-03-19T06:05:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.195+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0437e0 con 0x7f89cc0cb240 2024-03-19T06:05:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.195+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc1e5af0 con 0x7f89cc0cb240 2024-03-19T06:05:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.195+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc1f08f0 con 0x7f89cc0cb240 2024-03-19T06:05:51.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.196+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc067d60 con 0x7f89cc0cb240 2024-03-19T06:05:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.199+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f89bc037070 con 0x7f89cc0cb240 2024-03-19T06:05:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.199+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f89bc02f7b0 con 0x7f89cc0cb240 2024-03-19T06:05:51.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.305+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f89bc03e070 con 0x7f89cc0cb240 2024-03-19T06:05:51.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.384+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ea39ea9b-041e-44b6-a3a6-a64d65b66184", "id": 2} v 0) v1 -- 0x7f89cc0c46c0 con 0x7f89cc0cb240 2024-03-19T06:05:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.596+0000 7f89c2000640 1 -- 172.21.15.153:0/2781589462 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea39ea9b-041e-44b6-a3a6-a64d65b66184", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89bc030720 con 0x7f89cc0cb240 2024-03-19T06:05:51.588 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-03-19T06:05:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.597+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 msgr2=0x7f89cc1f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.597+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009990 tx=0x7f89bc0046c0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 shutdown_connections 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89cc15de20 0x7f89cc0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89cc154220 0x7f89cc0c85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 --2- 172.21.15.153:0/2781589462 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89cc0cb240 0x7f89cc1f13d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 >> 172.21.15.153:0/2781589462 conn(0x7f89cc06c170 msgr2=0x7f89cc15d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 shutdown_connections 2024-03-19T06:05:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.598+0000 7f89d0c00640 1 -- 172.21.15.153:0/2781589462 wait complete. 2024-03-19T06:05:51.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a24e2f49-1b63-4e94-9d81-2d1e5ef0113d 3 2024-03-19T06:05:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.846+0000 7f0b4a400640 1 Processor -- start 2024-03-19T06:05:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.846+0000 7f0b4a400640 1 -- start start 2024-03-19T06:05:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.847+0000 7f0b4a400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0b440cb8d0 0x7f0b440cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.847+0000 7f0b4a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b440cb2d0 0x7f0b4415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.847+0000 7f0b4a400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4415d3b0 con 0x7f0b441541d0 2024-03-19T06:05:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.847+0000 7f0b4a400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b440ca9b0 con 0x7f0b440cb8d0 2024-03-19T06:05:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.847+0000 7f0b4a400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4415a0d0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.848+0000 7f0b43e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b440cb2d0 0x7f0b4415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.849+0000 7f0b43e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b440cb2d0 0x7f0b4415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41154/0 (socket says 172.21.15.153:41154) 2024-03-19T06:05:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.849+0000 7f0b43e00640 1 -- 172.21.15.153:0/3895785477 learned_addr learned my addr 172.21.15.153:0/3895785477 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.850+0000 7f0b3be00640 1 --2- 172.21.15.153:0/3895785477 >> v2:172.21.15.17:3300/0 conn(0x7f0b440cb8d0 0x7f0b440cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.851+0000 7f0b43e00640 1 -- 172.21.15.153:0/3895785477 >> v2:172.21.15.17:3300/0 conn(0x7f0b440cb8d0 msgr2=0x7f0b440cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.851+0000 7f0b43e00640 1 --2- 172.21.15.153:0/3895785477 >> v2:172.21.15.17:3300/0 conn(0x7f0b440cb8d0 0x7f0b440cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.851+0000 7f0b43e00640 1 -- 172.21.15.153:0/3895785477 >> v1:172.21.15.17:6789/0 conn(0x7f0b441541d0 legacy=0x7f0b440ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.851+0000 7f0b43e00640 1 -- 172.21.15.153:0/3895785477 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4415a3b0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.854+0000 7f0b43e00640 1 --2- 172.21.15.153:0/3895785477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb2d0 0x7f0b4415d860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b440cbf40 tx=0x7f0b3c02c010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae3acf6e75313b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.859+0000 7f0b42a00640 1 -- 172.21.15.153:0/3895785477 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c02cbb0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.859+0000 7f0b42a00640 1 -- 172.21.15.153:0/3895785477 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c02cd50 con 0x7f0b440cb2d0 2024-03-19T06:05:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.859+0000 7f0b42a00640 1 -- 172.21.15.153:0/3895785477 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c034610 con 0x7f0b440cb2d0 2024-03-19T06:05:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 -- 172.21.15.153:0/3895785477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb2d0 msgr2=0x7f0b4415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 --2- 172.21.15.153:0/3895785477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb2d0 0x7f0b4415d860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0b440cbf40 tx=0x7f0b3c02c010 comp rx=0 tx=0).stop 2024-03-19T06:05:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 -- 172.21.15.153:0/3895785477 shutdown_connections 2024-03-19T06:05:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 --2- 172.21.15.153:0/3895785477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb2d0 0x7f0b4415d860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 --2- 172.21.15.153:0/3895785477 >> v2:172.21.15.17:3300/0 conn(0x7f0b440cb8d0 0x7f0b440cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 -- 172.21.15.153:0/3895785477 >> 172.21.15.153:0/3895785477 conn(0x7f0b4406baf0 msgr2=0x7f0b4406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 -- 172.21.15.153:0/3895785477 shutdown_connections 2024-03-19T06:05:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.860+0000 7f0b4a400640 1 -- 172.21.15.153:0/3895785477 wait complete. 2024-03-19T06:05:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.862+0000 7f0b4a400640 1 Processor -- start 2024-03-19T06:05:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.862+0000 7f0b4a400640 1 -- start start 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb8d0 0x7f0b440cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b441541d0 0x7f0b44158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b44159da0 con 0x7f0b441541d0 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4415a970 con 0x7f0b440cb8d0 2024-03-19T06:05:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.863+0000 7f0b4a400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4415ac50 con 0x7f0b440cb2d0 2024-03-19T06:05:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.864+0000 7f0b43400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.865+0000 7f0b43e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b441541d0 0x7f0b44158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.865+0000 7f0b43400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:40640/0 (socket says 172.21.15.153:40640) 2024-03-19T06:05:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.865+0000 7f0b43400640 1 -- 172.21.15.153:0/2662144571 learned_addr learned my addr 172.21.15.153:0/2662144571 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.866+0000 7f0b3be00640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb8d0 0x7f0b440cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.870+0000 7f0b43400640 1 -- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb8d0 msgr2=0x7f0b440cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.870+0000 7f0b43400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb8d0 0x7f0b440cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.870+0000 7f0b43400640 1 -- 172.21.15.153:0/2662144571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b441541d0 msgr2=0x7f0b44158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.870+0000 7f0b43400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b441541d0 0x7f0b44158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.870+0000 7f0b43400640 1 -- 172.21.15.153:0/2662144571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b441effd0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.873+0000 7f0b43400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c3c0 tx=0x7f0b3400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:51.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.877+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b340052d0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.877+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34005490 con 0x7f0b440cb2d0 2024-03-19T06:05:51.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.877+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007260 con 0x7f0b440cb2d0 2024-03-19T06:05:51.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.878+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b441f0290 con 0x7f0b440cb2d0 2024-03-19T06:05:51.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.878+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b44157db0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:51.879+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b44069be0 con 0x7f0b440cb2d0 2024-03-19T06:05:51.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.000+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0b34007400 con 0x7f0b440cb2d0 2024-03-19T06:05:51.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.000+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0b34011590 con 0x7f0b440cb2d0 2024-03-19T06:05:51.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.000+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0b340118a0 con 0x7f0b440cb2d0 2024-03-19T06:05:52.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.087+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a24e2f49-1b63-4e94-9d81-2d1e5ef0113d", "id": 3} v 0) v1 -- 0x7f0b440cab70 con 0x7f0b440cb2d0 2024-03-19T06:05:52.195 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:52.203+0000 7f6411c46040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-19T06:05:52.255 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:52.263+0000 7fcf17638040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-19T06:05:52.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.360+0000 7f0b3b400640 1 -- 172.21.15.153:0/2662144571 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a24e2f49-1b63-4e94-9d81-2d1e5ef0113d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b34003a30 con 0x7f0b440cb2d0 2024-03-19T06:05:52.352 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 msgr2=0x7f0b441597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c3c0 tx=0x7f0b3400c880 comp rx=0 tx=0).stop 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 shutdown_connections 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b441541d0 0x7f0b44158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b440cb8d0 0x7f0b440cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.362+0000 7f0b4a400640 1 --2- 172.21.15.153:0/2662144571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0b440cb2d0 0x7f0b441597e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.363+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 >> 172.21.15.153:0/2662144571 conn(0x7f0b4406baf0 msgr2=0x7f0b440ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:52.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.363+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 shutdown_connections 2024-03-19T06:05:52.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.363+0000 7f0b4a400640 1 -- 172.21.15.153:0/2662144571 wait complete. 2024-03-19T06:05:52.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e 4 2024-03-19T06:05:52.532 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:52.540+0000 7f6411c46040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-19T06:05:52.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.571+0000 7f79a9400640 1 Processor -- start 2024-03-19T06:05:52.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.571+0000 7f79a9400640 1 -- start start 2024-03-19T06:05:52.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.573+0000 7f79a9400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79a41541d0 0x7f79a40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.573+0000 7f79a9400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79a40cb8d0 0x7f79a40cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.573+0000 7f79a9400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a415d3b0 con 0x7f79a40cb2d0 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.573+0000 7f79a9400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a415a0d0 con 0x7f79a40cb8d0 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.573+0000 7f79a9400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a415a3b0 con 0x7f79a41541d0 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.574+0000 7f79a2800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79a41541d0 0x7f79a40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.574+0000 7f79a3200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f79a40cb2d0 0x7f79a415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52930/0 (socket says 172.21.15.153:52930) 2024-03-19T06:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.574+0000 7f79a3200640 1 -- 172.21.15.153:0/2177215533 learned_addr learned my addr 172.21.15.153:0/2177215533 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-19T06:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.578+0000 7f79a2800640 1 -- 172.21.15.153:0/2177215533 >> v2:172.21.15.17:3300/0 conn(0x7f79a40cb8d0 msgr2=0x7f79a40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.578+0000 7f79a2800640 1 --2- 172.21.15.153:0/2177215533 >> v2:172.21.15.17:3300/0 conn(0x7f79a40cb8d0 0x7f79a40cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.578+0000 7f79a2800640 1 -- 172.21.15.153:0/2177215533 >> v1:172.21.15.153:6789/0 conn(0x7f79a40cb2d0 legacy=0x7f79a415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.578+0000 7f79a2800640 1 -- 172.21.15.153:0/2177215533 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a415a690 con 0x7f79a41541d0 2024-03-19T06:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.582+0000 7f79a2800640 1 --2- 172.21.15.153:0/2177215533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a41541d0 0x7f79a40ca2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79a408cb70 tx=0x7f799402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92af8a3c3ab3aa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.587+0000 7f79a1400640 1 -- 172.21.15.153:0/2177215533 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994034070 con 0x7f79a41541d0 2024-03-19T06:05:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.587+0000 7f79a1400640 1 -- 172.21.15.153:0/2177215533 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994030610 con 0x7f79a41541d0 2024-03-19T06:05:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.587+0000 7f79a1400640 1 -- 172.21.15.153:0/2177215533 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940309e0 con 0x7f79a41541d0 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 -- 172.21.15.153:0/2177215533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a41541d0 msgr2=0x7f79a40ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 --2- 172.21.15.153:0/2177215533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a41541d0 0x7f79a40ca2a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79a408cb70 tx=0x7f799402b960 comp rx=0 tx=0).stop 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 -- 172.21.15.153:0/2177215533 shutdown_connections 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 --2- 172.21.15.153:0/2177215533 >> v2:172.21.15.17:3300/0 conn(0x7f79a40cb8d0 0x7f79a40cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 --2- 172.21.15.153:0/2177215533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a41541d0 0x7f79a40ca2a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 -- 172.21.15.153:0/2177215533 >> 172.21.15.153:0/2177215533 conn(0x7f79a406baf0 msgr2=0x7f79a406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 -- 172.21.15.153:0/2177215533 shutdown_connections 2024-03-19T06:05:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.588+0000 7f79a9400640 1 -- 172.21.15.153:0/2177215533 wait complete. 2024-03-19T06:05:52.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.590+0000 7f79a9400640 1 Processor -- start 2024-03-19T06:05:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.590+0000 7f79a9400640 1 -- start start 2024-03-19T06:05:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 0x7f79a415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 0x7f79a4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a41541d0 0x7f79a41f3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a415ac50 con 0x7f79a41541d0 2024-03-19T06:05:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a4159da0 con 0x7f79a40cb2d0 2024-03-19T06:05:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.591+0000 7f79a9400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40ca7e0 con 0x7f79a40cb8d0 2024-03-19T06:05:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.592+0000 7f79a2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 0x7f79a415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.592+0000 7f79a1e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 0x7f79a4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.592+0000 7f79a2800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 0x7f79a415c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41178/0 (socket says 172.21.15.153:41178) 2024-03-19T06:05:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.592+0000 7f79a2800640 1 -- 172.21.15.153:0/1898236297 learned_addr learned my addr 172.21.15.153:0/1898236297 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.593+0000 7f79a3200640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a41541d0 0x7f79a41f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.597+0000 7f79a1e00640 1 -- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 msgr2=0x7f79a415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.597+0000 7f79a1e00640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 0x7f79a415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.597+0000 7f79a1e00640 1 -- 172.21.15.153:0/1898236297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a41541d0 msgr2=0x7f79a41f3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.597+0000 7f79a1e00640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a41541d0 0x7f79a41f3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.597+0000 7f79a1e00640 1 -- 172.21.15.153:0/1898236297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4157330 con 0x7f79a40cb8d0 2024-03-19T06:05:52.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.600+0000 7f79a1e00640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 0x7f79a4152730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b420 tx=0x7f798c00b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:52.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.605+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011830 con 0x7f79a40cb8d0 2024-03-19T06:05:52.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.605+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c016070 con 0x7f79a40cb8d0 2024-03-19T06:05:52.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.605+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c011c10 con 0x7f79a40cb8d0 2024-03-19T06:05:52.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.605+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a41513f0 con 0x7f79a40cb8d0 2024-03-19T06:05:52.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.606+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a4151970 con 0x7f79a40cb8d0 2024-03-19T06:05:52.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.607+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a4069be0 con 0x7f79a40cb8d0 2024-03-19T06:05:52.598 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:52.607+0000 7f6411c46040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-19T06:05:52.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.610+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f798c01b460 con 0x7f79a40cb8d0 2024-03-19T06:05:52.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.610+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f798c024b50 con 0x7f79a40cb8d0 2024-03-19T06:05:52.606 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:52.614+0000 7fcf17638040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-19T06:05:52.671 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:52.679+0000 7fcf17638040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-19T06:05:52.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.718+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f798c011db0 con 0x7f79a40cb8d0 2024-03-19T06:05:52.735 INFO:tasks.ceph.mgr.x.smithi153.stderr:2024-03-19T06:05:52.744+0000 7f6411c46040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-19T06:05:52.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:52.802+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e", "id": 4} v 0) v1 -- 0x7f79a40b3450 con 0x7f79a40cb8d0 2024-03-19T06:05:52.807 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:52.814+0000 7fcf17638040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-19T06:05:53.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.173+0000 7f799aa00640 1 -- 172.21.15.153:0/1898236297 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f798c0245b0 con 0x7f79a40cb8d0 2024-03-19T06:05:53.165 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 msgr2=0x7f79a4152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 0x7f79a4152730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f798c00b420 tx=0x7f798c00b8e0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 shutdown_connections 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79a41541d0 0x7f79a41f3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f79a40cb8d0 0x7f79a4152730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 --2- 172.21.15.153:0/1898236297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a40cb2d0 0x7f79a415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 >> 172.21.15.153:0/1898236297 conn(0x7f79a406baf0 msgr2=0x7f79a40b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 shutdown_connections 2024-03-19T06:05:53.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.175+0000 7f79a9400640 1 -- 172.21.15.153:0/1898236297 wait complete. 2024-03-19T06:05:53.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 407c9283-7a38-4330-878a-a2fc8c1a92d3 5 2024-03-19T06:05:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.390+0000 7efdcb800640 1 Processor -- start 2024-03-19T06:05:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.390+0000 7efdcb800640 1 -- start start 2024-03-19T06:05:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.392+0000 7efdcb800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efdc415aa00 0x7efdc40c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.392+0000 7efdcb800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc41542b0 con 0x7efdc4153ed0 2024-03-19T06:05:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.392+0000 7efdcb800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc415d5c0 con 0x7efdc40c6720 2024-03-19T06:05:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.392+0000 7efdcb800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc415e1d0 con 0x7efdc415aa00 2024-03-19T06:05:53.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.393+0000 7efdc9800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efdc40c6720 0x7efdc4070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41994/0 (socket says 172.21.15.153:41994) 2024-03-19T06:05:53.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.393+0000 7efdc9800640 1 -- 172.21.15.153:0/1951315970 learned_addr learned my addr 172.21.15.153:0/1951315970 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-19T06:05:53.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.435+0000 7efdbbe00640 1 --2- 172.21.15.153:0/1951315970 >> v2:172.21.15.17:3300/0 conn(0x7efdc415aa00 0x7efdc40c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:53.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.447+0000 7efdc3e00640 1 -- 172.21.15.153:0/1951315970 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805629004 0 0) 0x7efdc41542b0 con 0x7efdc4153ed0 2024-03-19T06:05:53.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.447+0000 7efdc3e00640 1 -- 172.21.15.153:0/1951315970 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda4003520 con 0x7efdc4153ed0 2024-03-19T06:05:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.451+0000 7efdbbe00640 1 -- 172.21.15.153:0/1951315970 >> v1:172.21.15.153:6789/0 conn(0x7efdc40c6720 legacy=0x7efdc4070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.451+0000 7efdbbe00640 1 -- 172.21.15.153:0/1951315970 >> v1:172.21.15.17:6789/0 conn(0x7efdc4153ed0 legacy=0x7efdc406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.451+0000 7efdbbe00640 1 -- 172.21.15.153:0/1951315970 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc415d8a0 con 0x7efdc415aa00 2024-03-19T06:05:53.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.460+0000 7efdbbe00640 1 --2- 172.21.15.153:0/1951315970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc40c61e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efdb40097a0 tx=0x7efdb402b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cefbae469f5ed6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:53.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.472+0000 7efdc3e00640 1 -- 172.21.15.153:0/1951315970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb402f800 con 0x7efdc415aa00 2024-03-19T06:05:53.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.472+0000 7efdc3e00640 1 -- 172.21.15.153:0/1951315970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb402f9a0 con 0x7efdc415aa00 2024-03-19T06:05:53.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.472+0000 7efdc3e00640 1 -- 172.21.15.153:0/1951315970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb402fd70 con 0x7efdc415aa00 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.473+0000 7efdcb800640 1 -- 172.21.15.153:0/1951315970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 msgr2=0x7efdc40c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.473+0000 7efdcb800640 1 --2- 172.21.15.153:0/1951315970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc40c61e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efdb40097a0 tx=0x7efdb402b9e0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.473+0000 7efdcb800640 1 -- 172.21.15.153:0/1951315970 shutdown_connections 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.473+0000 7efdcb800640 1 --2- 172.21.15.153:0/1951315970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc40c61e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.473+0000 7efdcb800640 1 -- 172.21.15.153:0/1951315970 >> 172.21.15.153:0/1951315970 conn(0x7efdc40c8910 msgr2=0x7efdc40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.474+0000 7efdcb800640 1 -- 172.21.15.153:0/1951315970 shutdown_connections 2024-03-19T06:05:53.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.474+0000 7efdcb800640 1 -- 172.21.15.153:0/1951315970 wait complete. 2024-03-19T06:05:53.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.477+0000 7efdcb800640 1 Processor -- start 2024-03-19T06:05:53.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.477+0000 7efdcb800640 1 -- start start 2024-03-19T06:05:53.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40c6720 0x7efdc4152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:53.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc4153ed0 0x7efdc4149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:53.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:53.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc406ee30 con 0x7efdc415aa00 2024-03-19T06:05:53.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc415de60 con 0x7efdc40c6720 2024-03-19T06:05:53.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.478+0000 7efdcb800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc406efb0 con 0x7efdc4153ed0 2024-03-19T06:05:53.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.480+0000 7efdc9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:53.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.481+0000 7efdc9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.153:38216/0 (socket says 172.21.15.153:38216) 2024-03-19T06:05:53.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.481+0000 7efdc9800640 1 -- 172.21.15.153:0/3132199070 learned_addr learned my addr 172.21.15.153:0/3132199070 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:53.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.490+0000 7efdc9800640 1 -- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc4153ed0 msgr2=0x7efdc4149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.490+0000 7efdc9800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc4153ed0 0x7efdc4149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.491+0000 7efdc9800640 1 -- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40c6720 msgr2=0x7efdc4152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:53.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.491+0000 7efdc9800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40c6720 0x7efdc4152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:53.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.491+0000 7efdc9800640 1 -- 172.21.15.153:0/3132199070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc415d190 con 0x7efdc415aa00 2024-03-19T06:05:53.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.497+0000 7efdc9800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cbc0 tx=0x7efdbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.508+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc017070 con 0x7efdc415aa00 2024-03-19T06:05:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.509+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc00ad40 con 0x7efdc415aa00 2024-03-19T06:05:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.509+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc012600 con 0x7efdc415aa00 2024-03-19T06:05:53.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.509+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc4152900 con 0x7efdc415aa00 2024-03-19T06:05:53.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.509+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc41582f0 con 0x7efdc415aa00 2024-03-19T06:05:53.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.510+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc4069be0 con 0x7efdc415aa00 2024-03-19T06:05:53.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.699+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 2) v1 ==== 45093+0+0 (secure 0 0 0) 0x7efdbc01a070 con 0x7efdc415aa00 2024-03-19T06:05:53.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.722+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7efdbc01bda0 con 0x7efdc415aa00 2024-03-19T06:05:53.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.727+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efdbc01a360 con 0x7efdc415aa00 2024-03-19T06:05:53.794 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:53.802+0000 7fcf10800640 -1 mgr handle_mgr_map I was active but no longer am 2024-03-19T06:05:53.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:53.843+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd new", "uuid": "407c9283-7a38-4330-878a-a2fc8c1a92d3", "id": 5} v 0) v1 -- 0x7efdc40c23d0 con 0x7efdc415aa00 2024-03-19T06:05:54.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.160+0000 7efdc1600640 1 -- 172.21.15.153:0/3132199070 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "407c9283-7a38-4330-878a-a2fc8c1a92d3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdbc007260 con 0x7efdc415aa00 2024-03-19T06:05:54.152 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 msgr2=0x7efdc4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cbc0 tx=0x7efdbc00a430 comp rx=0 tx=0).stop 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 shutdown_connections 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc415aa00 0x7efdc4158dd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efdc4153ed0 0x7efdc4149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 --2- 172.21.15.153:0/3132199070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdc40c6720 0x7efdc4152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 >> 172.21.15.153:0/3132199070 conn(0x7efdc40c8910 msgr2=0x7efdc4071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:54.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 shutdown_connections 2024-03-19T06:05:54.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.163+0000 7efdcb800640 1 -- 172.21.15.153:0/3132199070 wait complete. 2024-03-19T06:05:54.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 6267f24d-9008-4cb3-8f2e-2a776bed6c50 6 2024-03-19T06:05:54.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.384+0000 7efec7200640 1 Processor -- start 2024-03-19T06:05:54.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.384+0000 7efec7200640 1 -- start start 2024-03-19T06:05:54.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.386+0000 7efec7200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efec01541d0 0x7efec00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:54.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.386+0000 7efec7200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec015d3b0 con 0x7efec00cb8d0 2024-03-19T06:05:54.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.386+0000 7efec7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec015a0d0 con 0x7efec015d860 2024-03-19T06:05:54.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.386+0000 7efec7200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec015a3b0 con 0x7efec01541d0 2024-03-19T06:05:54.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.387+0000 7efec5200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efec015d860 0x7efec015dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41996/0 (socket says 172.21.15.153:41996) 2024-03-19T06:05:54.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.387+0000 7efec5200640 1 -- 172.21.15.153:0/1753418679 learned_addr learned my addr 172.21.15.153:0/1753418679 (peer_addr_for_me v1:172.21.15.153:0/0) 2024-03-19T06:05:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.399+0000 7efebfe00640 1 --2- 172.21.15.153:0/1753418679 >> v2:172.21.15.17:3300/0 conn(0x7efec01541d0 0x7efec00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:54.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.417+0000 7efebfe00640 1 -- 172.21.15.153:0/1753418679 >> v1:172.21.15.153:6789/0 conn(0x7efec015d860 legacy=0x7efec015dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.417+0000 7efebfe00640 1 -- 172.21.15.153:0/1753418679 >> v1:172.21.15.17:6789/0 conn(0x7efec00cb8d0 legacy=0x7efec00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.417+0000 7efebfe00640 1 -- 172.21.15.153:0/1753418679 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec015a690 con 0x7efec01541d0 2024-03-19T06:05:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.602+0000 7efebfe00640 1 --2- 172.21.15.153:0/1753418679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec00ca2a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097a0 tx=0x7efeb002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340de0dc26144c49 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:54.600 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:54.608+0000 7f951884c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-19T06:05:54.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.619+0000 7efebf400640 1 -- 172.21.15.153:0/1753418679 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb002f810 con 0x7efec01541d0 2024-03-19T06:05:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.619+0000 7efebf400640 1 -- 172.21.15.153:0/1753418679 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb002f9b0 con 0x7efec01541d0 2024-03-19T06:05:54.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.619+0000 7efebf400640 1 -- 172.21.15.153:0/1753418679 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb002fd80 con 0x7efec01541d0 2024-03-19T06:05:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.620+0000 7efec7200640 1 -- 172.21.15.153:0/1753418679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 msgr2=0x7efec00ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.620+0000 7efec7200640 1 --2- 172.21.15.153:0/1753418679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec00ca2a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efeb00097a0 tx=0x7efeb002b9f0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.620+0000 7efec7200640 1 -- 172.21.15.153:0/1753418679 shutdown_connections 2024-03-19T06:05:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.620+0000 7efec7200640 1 --2- 172.21.15.153:0/1753418679 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec00ca2a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.620+0000 7efec7200640 1 -- 172.21.15.153:0/1753418679 >> 172.21.15.153:0/1753418679 conn(0x7efec006baf0 msgr2=0x7efec006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.621+0000 7efec7200640 1 -- 172.21.15.153:0/1753418679 shutdown_connections 2024-03-19T06:05:54.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.621+0000 7efec7200640 1 -- 172.21.15.153:0/1753418679 wait complete. 2024-03-19T06:05:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.624+0000 7efec7200640 1 Processor -- start 2024-03-19T06:05:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.624+0000 7efec7200640 1 -- start start 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec00cb8d0 0x7efec014b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec01e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec015ac50 con 0x7efec01541d0 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec0159da0 con 0x7efec00cb8d0 2024-03-19T06:05:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.625+0000 7efec7200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00cb4a0 con 0x7efec015d860 2024-03-19T06:05:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.626+0000 7efec5200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.627+0000 7efec5200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:45046/0 (socket says 172.21.15.153:45046) 2024-03-19T06:05:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.627+0000 7efec5200640 1 -- 172.21.15.153:0/762254923 learned_addr learned my addr 172.21.15.153:0/762254923 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:54.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.629+0000 7efeb7400640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec01e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.630+0000 7efec5200640 1 -- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec00cb8d0 msgr2=0x7efec014b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.630+0000 7efec5200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec00cb8d0 0x7efec014b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.630+0000 7efec5200640 1 -- 172.21.15.153:0/762254923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 msgr2=0x7efec01e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.631+0000 7efec5200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec01e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:54.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.631+0000 7efec5200640 1 -- 172.21.15.153:0/762254923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec014bdb0 con 0x7efec015d860 2024-03-19T06:05:54.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.633+0000 7efec5200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c370 tx=0x7efeb800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.637+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8017070 con 0x7efec015d860 2024-03-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.637+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8005ce0 con 0x7efec015d860 2024-03-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.637+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80072d0 con 0x7efec015d860 2024-03-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.637+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec014c040 con 0x7efec015d860 2024-03-19T06:05:54.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.637+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec01f2f70 con 0x7efec015d860 2024-03-19T06:05:54.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.639+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec01f3860 con 0x7efec015d860 2024-03-19T06:05:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.668+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 3) v1 ==== 89847+0+0 (secure 0 0 0) 0x7efeb801a070 con 0x7efec015d860 2024-03-19T06:05:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.671+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7efeb8088a80 con 0x7efec015d860 2024-03-19T06:05:54.662 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:54.670+0000 7f951884c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-19T06:05:54.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.795+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efeb80584d0 con 0x7efec015d860 2024-03-19T06:05:54.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:54.899+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6267f24d-9008-4cb3-8f2e-2a776bed6c50", "id": 6} v 0) v1 -- 0x7efec0069be0 con 0x7efec015d860 2024-03-19T06:05:55.156 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.164+0000 7f951884c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-19T06:05:55.212 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.220+0000 7f951884c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-19T06:05:55.265 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.273+0000 7f951884c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-19T06:05:55.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.301+0000 7efebcc00640 1 -- 172.21.15.153:0/762254923 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6267f24d-9008-4cb3-8f2e-2a776bed6c50", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7efeb805c570 con 0x7efec015d860 2024-03-19T06:05:55.292 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-03-19T06:05:55.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.302+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 msgr2=0x7efec014c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:55.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.302+0000 7efec7200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efeb800c370 tx=0x7efeb800c830 comp rx=0 tx=0).stop 2024-03-19T06:05:55.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 shutdown_connections 2024-03-19T06:05:55.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efec015d860 0x7efec014c4a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec01541d0 0x7efec01e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 --2- 172.21.15.153:0/762254923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec00cb8d0 0x7efec014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 >> 172.21.15.153:0/762254923 conn(0x7efec006baf0 msgr2=0x7efec00b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:55.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 shutdown_connections 2024-03-19T06:05:55.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.303+0000 7efec7200640 1 -- 172.21.15.153:0/762254923 wait complete. 2024-03-19T06:05:55.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a91e5ede-c41f-497e-8cda-3d146ea4c3cb 7 2024-03-19T06:05:55.330 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.338+0000 7f951884c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-19T06:05:55.381 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.389+0000 7f951884c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-19T06:05:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.520+0000 7f284f400640 1 Processor -- start 2024-03-19T06:05:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.520+0000 7f284f400640 1 -- start start 2024-03-19T06:05:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.521+0000 7f284f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.522+0000 7f284f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f284806eb60 0x7f2848070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.522+0000 7f284f400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28481542b0 con 0x7f284806e720 2024-03-19T06:05:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.522+0000 7f284f400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284806ef90 con 0x7f284806eb60 2024-03-19T06:05:55.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.522+0000 7f284f400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284815e1d0 con 0x7f2848153ed0 2024-03-19T06:05:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.522+0000 7f284ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.523+0000 7f284ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:45056/0 (socket says 172.21.15.153:45056) 2024-03-19T06:05:55.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.523+0000 7f284ca00640 1 -- 172.21.15.153:0/2612999569 learned_addr learned my addr 172.21.15.153:0/2612999569 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:55.514 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.523+0000 7f951884c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-19T06:05:55.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.523+0000 7f284d400640 1 --2- 172.21.15.153:0/2612999569 >> v2:172.21.15.17:3300/0 conn(0x7f284806eb60 0x7f2848070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.525+0000 7f284ca00640 1 -- 172.21.15.153:0/2612999569 >> v2:172.21.15.17:3300/0 conn(0x7f284806eb60 msgr2=0x7f2848070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.525+0000 7f284ca00640 1 --2- 172.21.15.153:0/2612999569 >> v2:172.21.15.17:3300/0 conn(0x7f284806eb60 0x7f2848070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.525+0000 7f284ca00640 1 -- 172.21.15.153:0/2612999569 >> v1:172.21.15.17:6789/0 conn(0x7f284806e720 legacy=0x7f28480c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:55.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.526+0000 7f284ca00640 1 -- 172.21.15.153:0/2612999569 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284815d5c0 con 0x7f2848153ed0 2024-03-19T06:05:55.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.528+0000 7f284ca00640 1 --2- 172.21.15.153:0/2612999569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f0185eb9dfa96ce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:55.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.532+0000 7f2847400640 1 -- 172.21.15.153:0/2612999569 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c035020 con 0x7f2848153ed0 2024-03-19T06:05:55.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f2847400640 1 -- 172.21.15.153:0/2612999569 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c031640 con 0x7f2848153ed0 2024-03-19T06:05:55.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f2847400640 1 -- 172.21.15.153:0/2612999569 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c02d040 con 0x7f2848153ed0 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 -- 172.21.15.153:0/2612999569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 msgr2=0x7f284815aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 --2- 172.21.15.153:0/2612999569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c02b8f0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 -- 172.21.15.153:0/2612999569 shutdown_connections 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 --2- 172.21.15.153:0/2612999569 >> v2:172.21.15.17:3300/0 conn(0x7f284806eb60 0x7f2848070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 --2- 172.21.15.153:0/2612999569 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2848153ed0 0x7f284815aa00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.533+0000 7f284f400640 1 -- 172.21.15.153:0/2612999569 >> 172.21.15.153:0/2612999569 conn(0x7f28480c8910 msgr2=0x7f28480cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.534+0000 7f284f400640 1 -- 172.21.15.153:0/2612999569 shutdown_connections 2024-03-19T06:05:55.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.534+0000 7f284f400640 1 -- 172.21.15.153:0/2612999569 wait complete. 2024-03-19T06:05:55.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.536+0000 7f284f400640 1 Processor -- start 2024-03-19T06:05:55.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.536+0000 7f284f400640 1 -- start start 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284806eb60 0x7f284814a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848153ed0 0x7f284815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284815de60 con 0x7f2848153ed0 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284815db80 con 0x7f284806eb60 2024-03-19T06:05:55.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284f400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28480c68f0 con 0x7f284806e720 2024-03-19T06:05:55.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.537+0000 7f284ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:55.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.538+0000 7f2847e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284806eb60 0x7f284814a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:55.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.538+0000 7f284ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.153:45072/0 (socket says 172.21.15.153:45072) 2024-03-19T06:05:55.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.538+0000 7f284ca00640 1 -- 172.21.15.153:0/2067837762 learned_addr learned my addr 172.21.15.153:0/2067837762 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-19T06:05:55.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.539+0000 7f284d400640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848153ed0 0x7f284815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.542+0000 7f284ca00640 1 -- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284806eb60 msgr2=0x7f284814a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.542+0000 7f284ca00640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284806eb60 0x7f284814a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.542+0000 7f284ca00640 1 -- 172.21.15.153:0/2067837762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848153ed0 msgr2=0x7f284815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.542+0000 7f284ca00640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848153ed0 0x7f284815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.542+0000 7f284ca00640 1 -- 172.21.15.153:0/2067837762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28480c9e70 con 0x7f284806e720 2024-03-19T06:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.546+0000 7f284ca00640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.550+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c040070 con 0x7f284806e720 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.550+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c039c10 con 0x7f284806e720 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.550+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28480ca130 con 0x7f284806e720 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.550+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c035040 con 0x7f284806e720 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.550+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28480ca6f0 con 0x7f284806e720 2024-03-19T06:05:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.551+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28480c4d40 con 0x7f284806e720 2024-03-19T06:05:55.581 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.589+0000 7f951884c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:55.632 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.641+0000 7f951884c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-19T06:05:55.692 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.700+0000 7f951884c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-19T06:05:55.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.700+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 3) v1 ==== 89847+0+0 (secure 0 0 0) 0x7f283c04b060 con 0x7f284806e720 2024-03-19T06:05:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.713+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f283c0788d0 con 0x7f284806e720 2024-03-19T06:05:55.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.713+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f28480c4d40 con 0x7f284806e720 2024-03-19T06:05:55.745 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:55.754+0000 7f951884c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-19T06:05:55.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:55.800+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a91e5ede-c41f-497e-8cda-3d146ea4c3cb", "id": 7} v 0) v1 -- 0x7f2848069be0 con 0x7f284806e720 2024-03-19T06:05:56.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.018+0000 7f2844c00640 1 -- 172.21.15.153:0/2067837762 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a91e5ede-c41f-497e-8cda-3d146ea4c3cb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f283c07a830 con 0x7f284806e720 2024-03-19T06:05:56.010 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-03-19T06:05:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 msgr2=0x7f2848149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f283c009870 tx=0x7f283c0046c0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 shutdown_connections 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2848153ed0 0x7f284815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f284806eb60 0x7f284814a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 --2- 172.21.15.153:0/2067837762 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f284806e720 0x7f2848149b50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 >> 172.21.15.153:0/2067837762 conn(0x7f28480c8910 msgr2=0x7f284806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 shutdown_connections 2024-03-19T06:05:56.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-19T06:05:56.021+0000 7f284f400640 1 -- 172.21.15.153:0/2067837762 wait complete. 2024-03-19T06:05:56.039 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-19T06:05:56.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-03-19T06:05:56.045 INFO:tasks.ceph.osd.0:Started 2024-03-19T06:05:56.045 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-19T06:05:56.045 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-03-19T06:05:56.051 INFO:tasks.ceph.osd.1:Started 2024-03-19T06:05:56.051 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-19T06:05:56.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-03-19T06:05:56.058 INFO:tasks.ceph.osd.2:Started 2024-03-19T06:05:56.058 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-19T06:05:56.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-03-19T06:05:56.063 INFO:tasks.ceph.osd.3:Started 2024-03-19T06:05:56.063 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-19T06:05:56.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-03-19T06:05:56.071 INFO:tasks.ceph.osd.4:Started 2024-03-19T06:05:56.071 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-19T06:05:56.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-03-19T06:05:56.079 INFO:tasks.ceph.osd.5:Started 2024-03-19T06:05:56.079 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-19T06:05:56.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-03-19T06:05:56.087 INFO:tasks.ceph.osd.6:Started 2024-03-19T06:05:56.088 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-19T06:05:56.088 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-03-19T06:05:56.094 INFO:tasks.ceph.osd.7:Started 2024-03-19T06:05:56.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:05:56.192 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.200+0000 7f951884c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-19T06:05:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.330+0000 7fa6ede00640 1 Processor -- start 2024-03-19T06:05:56.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.330+0000 7fa6ede00640 1 -- start start 2024-03-19T06:05:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.332+0000 7fa6ede00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa6e81541d0 0x7fa6e80ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.332+0000 7fa6ede00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e815d3b0 con 0x7fa6e80cb8d0 2024-03-19T06:05:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.332+0000 7fa6ede00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e815a0d0 con 0x7fa6e815d860 2024-03-19T06:05:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.332+0000 7fa6ede00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e815a3b0 con 0x7fa6e81541d0 2024-03-19T06:05:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.333+0000 7fa6e6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa6e81541d0 0x7fa6e80ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.333+0000 7fa6e7400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa6e815d860 0x7fa6e815dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:34026/0 (socket says 172.21.15.17:34026) 2024-03-19T06:05:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.333+0000 7fa6e7400640 1 -- 172.21.15.17:0/450661260 learned_addr learned my addr 172.21.15.17:0/450661260 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:05:56.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.336+0000 7fa6e6a00640 1 -- 172.21.15.17:0/450661260 >> v1:172.21.15.153:6789/0 conn(0x7fa6e815d860 legacy=0x7fa6e815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.337+0000 7fa6e6a00640 1 -- 172.21.15.17:0/450661260 >> v1:172.21.15.17:6789/0 conn(0x7fa6e80cb8d0 legacy=0x7fa6e80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.337+0000 7fa6e6a00640 1 -- 172.21.15.17:0/450661260 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e815a690 con 0x7fa6e81541d0 2024-03-19T06:05:56.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.341+0000 7fa6e6a00640 1 --2- 172.21.15.17:0/450661260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e80ca2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80097a0 tx=0x7fa6d802b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f3c9b6c0b463f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:56.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.346+0000 7fa6e5600640 1 -- 172.21.15.17:0/450661260 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d802f810 con 0x7fa6e81541d0 2024-03-19T06:05:56.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.346+0000 7fa6e5600640 1 -- 172.21.15.17:0/450661260 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d802f9b0 con 0x7fa6e81541d0 2024-03-19T06:05:56.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.346+0000 7fa6e5600640 1 -- 172.21.15.17:0/450661260 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d802fd80 con 0x7fa6e81541d0 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 -- 172.21.15.17:0/450661260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 msgr2=0x7fa6e80ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 --2- 172.21.15.17:0/450661260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e80ca2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80097a0 tx=0x7fa6d802b9f0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 -- 172.21.15.17:0/450661260 shutdown_connections 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 --2- 172.21.15.17:0/450661260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e80ca2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 -- 172.21.15.17:0/450661260 >> 172.21.15.17:0/450661260 conn(0x7fa6e806baf0 msgr2=0x7fa6e806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 -- 172.21.15.17:0/450661260 shutdown_connections 2024-03-19T06:05:56.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.347+0000 7fa6ede00640 1 -- 172.21.15.17:0/450661260 wait complete. 2024-03-19T06:05:56.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.349+0000 7fa6ede00640 1 Processor -- start 2024-03-19T06:05:56.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.349+0000 7fa6ede00640 1 -- start start 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6e80cb8d0 0x7fa6e8157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 0x7fa6e814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e815ac50 con 0x7fa6e815d860 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e8159da0 con 0x7fa6e81541d0 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.350+0000 7fa6ede00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e80cb4a0 con 0x7fa6e80cb8d0 2024-03-19T06:05:56.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.351+0000 7fa6e6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:56.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.351+0000 7fa6e7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 0x7fa6e814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:56.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.351+0000 7fa6e6a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6e80cb8d0 0x7fa6e8157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:56.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.351+0000 7fa6e6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:37784/0 (socket says 172.21.15.17:37784) 2024-03-19T06:05:56.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.351+0000 7fa6e6000640 1 -- 172.21.15.17:0/3737159393 learned_addr learned my addr 172.21.15.17:0/3737159393 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.354+0000 7fa6e6000640 1 -- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6e80cb8d0 msgr2=0x7fa6e8157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.355+0000 7fa6e6000640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6e80cb8d0 0x7fa6e8157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.355+0000 7fa6e6000640 1 -- 172.21.15.17:0/3737159393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 msgr2=0x7fa6e814dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.355+0000 7fa6e6000640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 0x7fa6e814dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.355+0000 7fa6e6000640 1 -- 172.21.15.17:0/3737159393 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e81f4c00 con 0x7fa6e81541d0 2024-03-19T06:05:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.355+0000 7fa6e7400640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 0x7fa6e814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-19T06:05:56.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.357+0000 7fa6e6000640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c450 tx=0x7fa6d400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.361+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40052d0 con 0x7fa6e81541d0 2024-03-19T06:05:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.361+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d4005470 con 0x7fa6e81541d0 2024-03-19T06:05:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.361+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e81f7e70 con 0x7fa6e81541d0 2024-03-19T06:05:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.361+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4012870 con 0x7fa6e81541d0 2024-03-19T06:05:56.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.361+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e81f4120 con 0x7fa6e81541d0 2024-03-19T06:05:56.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.362+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e8069be0 con 0x7fa6e81541d0 2024-03-19T06:05:56.394 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.403+0000 7f951884c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-19T06:05:56.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.507+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 3) v1 ==== 89847+0+0 (secure 0 0 0) 0x7fa6d4012a10 con 0x7fa6e81541d0 2024-03-19T06:05:56.508 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.517+0000 7f951884c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-19T06:05:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.527+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa6d4058010 con 0x7fa6e81541d0 2024-03-19T06:05:56.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.527+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa6d4059380 con 0x7fa6e81541d0 2024-03-19T06:05:56.561 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.570+0000 7f951884c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-19T06:05:56.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.601+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6e80cab70 con 0x7fa6e81541d0 2024-03-19T06:05:56.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.656+0000 7fa6df400640 1 -- 172.21.15.17:0/3737159393 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fa6d405d420 con 0x7fa6e81541d0 2024-03-19T06:05:56.648 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:05:56.648 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:05:55.829392+0000","last_up_change":"0.000000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:05:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 msgr2=0x7fa6e814ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400c450 tx=0x7fa6d400c910 comp rx=0 tx=0).stop 2024-03-19T06:05:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 shutdown_connections 2024-03-19T06:05:56.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6e815d860 0x7fa6e814dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6e81541d0 0x7fa6e814ec30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 --2- 172.21.15.17:0/3737159393 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa6e80cb8d0 0x7fa6e8157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 >> 172.21.15.17:0/3737159393 conn(0x7fa6e806baf0 msgr2=0x7fa6e80ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 shutdown_connections 2024-03-19T06:05:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:05:56.658+0000 7fa6ede00640 1 -- 172.21.15.17:0/3737159393 wait complete. 2024-03-19T06:05:56.670 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-19T06:05:56.671 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-19T06:05:56.695 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.704+0000 7f951884c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:56.785 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:05:56.794+0000 7f34abeb1640 -1 Falling back to public interface 2024-03-19T06:05:56.808 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:56.817+0000 7f951884c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-19T06:05:56.810 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:05:56.818+0000 7fc183573640 -1 Falling back to public interface 2024-03-19T06:05:56.810 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:05:56.819+0000 7f24a1726640 -1 Falling back to public interface 2024-03-19T06:05:56.822 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:05:56.831+0000 7fc29c4a6640 -1 Falling back to public interface 2024-03-19T06:05:56.824 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:05:56.832+0000 7fcab719e640 -1 Falling back to public interface 2024-03-19T06:05:56.836 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:05:56.845+0000 7f69ad806640 -1 Falling back to public interface 2024-03-19T06:05:56.850 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:05:56.859+0000 7f96b48cc640 -1 Falling back to public interface 2024-03-19T06:05:56.852 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:05:56.861+0000 7f3a7c012640 -1 Falling back to public interface 2024-03-19T06:05:57.000 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:57.008+0000 7f951884c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-19T06:05:57.051 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:57.060+0000 7f951884c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-19T06:05:57.198 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:57.206+0000 7f951884c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-19T06:05:57.477 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:05:57.633 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.642+0000 7fab31c00640 1 Processor -- start 2024-03-19T06:05:57.633 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.642+0000 7fab31c00640 1 -- start start 2024-03-19T06:05:57.634 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.643+0000 7fab31c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab2c152260 0x7fab2c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:57.634 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.643+0000 7fab31c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2c0ca540 0x7fab2c0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.643+0000 7fab31c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c070d30 con 0x7fab2c0ca940 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.643+0000 7fab31c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c070fa0 con 0x7fab2c0ca540 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.643+0000 7fab31c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c0b0890 con 0x7fab2c152260 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.644+0000 7fab23e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2c0ca540 0x7fab2c0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.644+0000 7fab23e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2c0ca540 0x7fab2c0cd4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55134/0 (socket says 172.21.15.17:55134) 2024-03-19T06:05:57.635 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.644+0000 7fab23e00640 1 -- 172.21.15.17:0/2180346718 learned_addr learned my addr 172.21.15.17:0/2180346718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:05:57.636 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.645+0000 7fab2aa00640 1 --2- 172.21.15.17:0/2180346718 >> v2:172.21.15.153:3300/0 conn(0x7fab2c152260 0x7fab2c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:57.638 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.647+0000 7fab23e00640 1 -- 172.21.15.17:0/2180346718 >> v2:172.21.15.153:3300/0 conn(0x7fab2c152260 msgr2=0x7fab2c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:05:57.638 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.647+0000 7fab23e00640 1 --2- 172.21.15.17:0/2180346718 >> v2:172.21.15.153:3300/0 conn(0x7fab2c152260 0x7fab2c0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.638 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.647+0000 7fab23e00640 1 -- 172.21.15.17:0/2180346718 >> v1:172.21.15.153:6789/0 conn(0x7fab2c0ca940 legacy=0x7fab2c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:57.638 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.647+0000 7fab23e00640 1 -- 172.21.15.17:0/2180346718 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0b0b70 con 0x7fab2c0ca540 2024-03-19T06:05:57.641 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.650+0000 7fab23e00640 1 --2- 172.21.15.17:0/2180346718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0cd4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0b04b0 tx=0x7fab1402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e703a94aa6b3ce22 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:57.645 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.654+0000 7fab2a000640 1 -- 172.21.15.17:0/2180346718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1402f850 con 0x7fab2c0ca540 2024-03-19T06:05:57.645 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.654+0000 7fab2a000640 1 -- 172.21.15.17:0/2180346718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1402f9f0 con 0x7fab2c0ca540 2024-03-19T06:05:57.646 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.654+0000 7fab2a000640 1 -- 172.21.15.17:0/2180346718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1402fdc0 con 0x7fab2c0ca540 2024-03-19T06:05:57.646 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 -- 172.21.15.17:0/2180346718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 msgr2=0x7fab2c0cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 --2- 172.21.15.17:0/2180346718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0cd4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0b04b0 tx=0x7fab1402ba30 comp rx=0 tx=0).stop 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 -- 172.21.15.17:0/2180346718 shutdown_connections 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 --2- 172.21.15.17:0/2180346718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0cd4d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 --2- 172.21.15.17:0/2180346718 >> v2:172.21.15.153:3300/0 conn(0x7fab2c152260 0x7fab2c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 -- 172.21.15.17:0/2180346718 >> 172.21.15.17:0/2180346718 conn(0x7fab2c06eef0 msgr2=0x7fab2c06fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.655+0000 7fab31c00640 1 -- 172.21.15.17:0/2180346718 shutdown_connections 2024-03-19T06:05:57.647 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.656+0000 7fab31c00640 1 -- 172.21.15.17:0/2180346718 wait complete. 2024-03-19T06:05:57.649 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.657+0000 7fab31c00640 1 Processor -- start 2024-03-19T06:05:57.649 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 -- start start 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab2c0ca940 0x7fab2c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab2c152260 0x7fab2c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0ce2a0 con 0x7fab2c0ca540 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0ce120 con 0x7fab2c152260 2024-03-19T06:05:57.650 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.658+0000 7fab31c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0c98f0 con 0x7fab2c0ca940 2024-03-19T06:05:57.651 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.659+0000 7fab2aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:57.651 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.659+0000 7fab2aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55144/0 (socket says 172.21.15.17:55144) 2024-03-19T06:05:57.651 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.659+0000 7fab2aa00640 1 -- 172.21.15.17:0/3855205675 learned_addr learned my addr 172.21.15.17:0/3855205675 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:05:57.651 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.660+0000 7fab2b400640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab2c152260 0x7fab2c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:57.651 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.660+0000 7fab23e00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab2c0ca940 0x7fab2c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:05:57.654 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.663+0000 7fab2aa00640 1 -- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab2c0ca940 msgr2=0x7fab2c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:57.654 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.663+0000 7fab2aa00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab2c0ca940 0x7fab2c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.654 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.663+0000 7fab2aa00640 1 -- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab2c152260 msgr2=0x7fab2c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:57.655 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.663+0000 7fab2aa00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab2c152260 0x7fab2c06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.655 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.663+0000 7fab2aa00640 1 -- 172.21.15.17:0/3855205675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c150270 con 0x7fab2c0ca540 2024-03-19T06:05:57.657 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.666+0000 7fab2aa00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00d620 tx=0x7fab1c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:05:57.662 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.670+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00b620 con 0x7fab2c0ca540 2024-03-19T06:05:57.662 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.670+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c019070 con 0x7fab2c0ca540 2024-03-19T06:05:57.662 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.671+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c00ba00 con 0x7fab2c0ca540 2024-03-19T06:05:57.662 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.671+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c0ad9f0 con 0x7fab2c0ca540 2024-03-19T06:05:57.662 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.671+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c14b470 con 0x7fab2c0ca540 2024-03-19T06:05:57.663 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.672+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c04f050 con 0x7fab2c0ca540 2024-03-19T06:05:57.685 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.694+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) v1 ==== 89847+0+0 (secure 0 0 0) 0x7fab1c00bba0 con 0x7fab2c0ca540 2024-03-19T06:05:57.688 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.697+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fab1c058840 con 0x7fab2c0ca540 2024-03-19T06:05:57.798 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.807+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fab1c059bb0 con 0x7fab2c0ca540 2024-03-19T06:05:57.874 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.882+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab2c0cad50 con 0x7fab2c0ca540 2024-03-19T06:05:57.925 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.934+0000 7fab22a00640 1 -- 172.21.15.17:0/3855205675 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fab1c05dc50 con 0x7fab2c0ca540 2024-03-19T06:05:57.926 INFO:teuthology.misc.health.smithi017.stdout: 2024-03-19T06:05:57.926 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:05:55.829392+0000","last_up_change":"0.000000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:05:57.927 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 msgr2=0x7fab2c0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:05:57.927 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00d620 tx=0x7fab1c00dae0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.927 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 shutdown_connections 2024-03-19T06:05:57.927 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab2c152260 0x7fab2c06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.928 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fab2c0ca940 0x7fab2c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.928 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 --2- 172.21.15.17:0/3855205675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2c0ca540 0x7fab2c0aea40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:05:57.928 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 >> 172.21.15.17:0/3855205675 conn(0x7fab2c06eef0 msgr2=0x7fab2c0b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:05:57.928 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 shutdown_connections 2024-03-19T06:05:57.928 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:05:57.935+0000 7fab31c00640 1 -- 172.21.15.17:0/3855205675 wait complete. 2024-03-19T06:05:57.939 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-19T06:05:58.002 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:58.011+0000 7f951884c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-19T06:05:58.323 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:58.332+0000 7f951884c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-19T06:05:58.383 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:58.392+0000 7f951884c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-19T06:05:58.520 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:05:58.529+0000 7f951884c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-19T06:06:00.169 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:06:00.178+0000 7f96b48cc640 -1 osd.0 0 log_to_monitors true 2024-03-19T06:06:00.185 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:06:00.193+0000 7fc183573640 -1 osd.6 0 log_to_monitors true 2024-03-19T06:06:00.384 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:06:00.393+0000 7fc29c4a6640 -1 osd.2 0 log_to_monitors true 2024-03-19T06:06:00.398 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:06:00.407+0000 7f3a7c012640 -1 osd.1 0 log_to_monitors true 2024-03-19T06:06:00.407 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:06:00.416+0000 7f69ad806640 -1 osd.3 0 log_to_monitors true 2024-03-19T06:06:00.571 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:06:00.580+0000 7f34abeb1640 -1 osd.4 0 log_to_monitors true 2024-03-19T06:06:00.604 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:06:00.613+0000 7f24a1726640 -1 osd.5 0 log_to_monitors true 2024-03-19T06:06:00.675 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:06:00.684+0000 7fcab719e640 -1 osd.7 0 log_to_monitors true 2024-03-19T06:06:01.430 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:06:01.439+0000 7f94b9200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-19T06:06:01.662 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:06:01.671+0000 7f94b9200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-19T06:06:04.410 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:06:04.419+0000 7fc17ee00640 -1 osd.6 0 waiting for initial osdmap 2024-03-19T06:06:04.513 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:06:04.522+0000 7f96af800640 -1 osd.0 0 waiting for initial osdmap 2024-03-19T06:06:04.523 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:06:04.533+0000 7fc297e00640 -1 osd.2 0 waiting for initial osdmap 2024-03-19T06:06:04.546 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:06:04.554+0000 7fc174400640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:04.624 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:06:04.633+0000 7f3a76800640 -1 osd.1 0 waiting for initial osdmap 2024-03-19T06:06:04.706 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:06:04.715+0000 7f96a5800640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:04.722 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:06:04.731+0000 7f3a6c800640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:04.745 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:04.746 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:06:04.755+0000 7fc28d400640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:04.916 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.924+0000 7ff426000640 1 Processor -- start 2024-03-19T06:06:04.916 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.925+0000 7ff426000640 1 -- start start 2024-03-19T06:06:04.918 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.927+0000 7ff426000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4200ca890 0x7ff42015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:04.918 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.927+0000 7ff426000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42015ae70 con 0x7ff4200cac70 2024-03-19T06:06:04.918 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.927+0000 7ff426000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200cff10 con 0x7ff420153cd0 2024-03-19T06:06:04.918 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.927+0000 7ff426000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42015e150 con 0x7ff4200ca890 2024-03-19T06:06:04.924 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.933+0000 7ff41f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4200ca890 0x7ff42015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:04.925 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.934+0000 7ff41f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4200ca890 0x7ff42015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41836/0 (socket says 172.21.15.17:41836) 2024-03-19T06:06:04.925 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.934+0000 7ff41f400640 1 -- 172.21.15.17:0/1254152094 learned_addr learned my addr 172.21.15.17:0/1254152094 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:04.930 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.938+0000 7ff41f400640 1 -- 172.21.15.17:0/1254152094 >> v1:172.21.15.153:6789/0 conn(0x7ff420153cd0 legacy=0x7ff4200c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:04.930 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.938+0000 7ff41f400640 1 -- 172.21.15.17:0/1254152094 >> v1:172.21.15.17:6789/0 conn(0x7ff4200cac70 legacy=0x7ff4200cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:04.930 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.938+0000 7ff41f400640 1 -- 172.21.15.17:0/1254152094 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42015d540 con 0x7ff4200ca890 2024-03-19T06:06:04.933 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:04.942+0000 7ff41f400640 1 --2- 172.21.15.17:0/1254152094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42015a930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff410009870 tx=0x7ff41002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903d43310b19dea9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:05.129 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.138+0000 7ff41e000640 1 -- 172.21.15.17:0/1254152094 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41002f840 con 0x7ff4200ca890 2024-03-19T06:06:05.129 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.138+0000 7ff41e000640 1 -- 172.21.15.17:0/1254152094 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41002f9e0 con 0x7ff4200ca890 2024-03-19T06:06:05.129 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.138+0000 7ff41e000640 1 -- 172.21.15.17:0/1254152094 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41002fdb0 con 0x7ff4200ca890 2024-03-19T06:06:05.130 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 -- 172.21.15.17:0/1254152094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 msgr2=0x7ff42015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 --2- 172.21.15.17:0/1254152094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42015a930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff410009870 tx=0x7ff41002ba20 comp rx=0 tx=0).stop 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 -- 172.21.15.17:0/1254152094 shutdown_connections 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 --2- 172.21.15.17:0/1254152094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42015a930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 -- 172.21.15.17:0/1254152094 >> 172.21.15.17:0/1254152094 conn(0x7ff42006bd20 msgr2=0x7ff42006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 -- 172.21.15.17:0/1254152094 shutdown_connections 2024-03-19T06:06:05.131 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.139+0000 7ff426000640 1 -- 172.21.15.17:0/1254152094 wait complete. 2024-03-19T06:06:05.132 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.141+0000 7ff426000640 1 Processor -- start 2024-03-19T06:06:05.133 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.142+0000 7ff426000640 1 -- start start 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4200cac70 0x7ff42014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420153cd0 0x7ff4201f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42015db00 con 0x7ff420153cd0 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4200cfcc0 con 0x7ff4200ca890 2024-03-19T06:06:05.134 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.143+0000 7ff426000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42015dde0 con 0x7ff4200cac70 2024-03-19T06:06:05.135 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.144+0000 7ff41f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:05.135 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.144+0000 7ff41f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41840/0 (socket says 172.21.15.17:41840) 2024-03-19T06:06:05.135 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.144+0000 7ff41f400640 1 -- 172.21.15.17:0/1196652957 learned_addr learned my addr 172.21.15.17:0/1196652957 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:05.140 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.149+0000 7ff41f400640 1 -- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4200cac70 msgr2=0x7ff42014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:05.140 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.149+0000 7ff41f400640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4200cac70 0x7ff42014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:05.140 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.149+0000 7ff41f400640 1 -- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420153cd0 msgr2=0x7ff4201f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:05.140 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.149+0000 7ff41f400640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420153cd0 0x7ff4201f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:05.140 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.149+0000 7ff41f400640 1 -- 172.21.15.17:0/1196652957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42014e2e0 con 0x7ff4200ca890 2024-03-19T06:06:05.142 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.152+0000 7ff41f400640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff410009870 tx=0x7ff410004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:05.148 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.156+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410041400 con 0x7ff4200ca890 2024-03-19T06:06:05.148 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.157+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410046070 con 0x7ff4200ca890 2024-03-19T06:06:05.148 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.157+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100417e0 con 0x7ff4200ca890 2024-03-19T06:06:05.148 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.157+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff420150b40 con 0x7ff4200ca890 2024-03-19T06:06:05.148 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.157+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420151100 con 0x7ff4200ca890 2024-03-19T06:06:05.149 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.158+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42004f050 con 0x7ff4200ca890 2024-03-19T06:06:05.218 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:06:05.226+0000 7f69a9000640 -1 osd.3 0 waiting for initial osdmap 2024-03-19T06:06:05.243 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.252+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 6) v1 ==== 90080+0+0 (secure 0 0 0) 0x7ff410040070 con 0x7ff4200ca890 2024-03-19T06:06:05.244 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.253+0000 7ff417400640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 0x7ff3fc06e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:05.244 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.253+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff4100ace20 con 0x7ff4200ca890 2024-03-19T06:06:05.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.254+0000 7ff41ea00640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 0x7ff3fc06e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:05.246 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.255+0000 7ff41ea00640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 0x7ff3fc06e050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff420153890 tx=0x7ff408007990 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:05.602 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.611+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7ff410033030 con 0x7ff4200ca890 2024-03-19T06:06:05.725 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:06:05.734+0000 7f699e600640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:05.844 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:05.853+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4200cb180 con 0x7ff4200ca890 2024-03-19T06:06:06.045 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:06:06.053+0000 7f34a6e00640 -1 osd.4 0 waiting for initial osdmap 2024-03-19T06:06:06.063 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:06:06.072+0000 7fcab2a00640 -1 osd.7 0 waiting for initial osdmap 2024-03-19T06:06:06.098 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:06:06.107+0000 7f249c600640 -1 osd.5 0 waiting for initial osdmap 2024-03-19T06:06:06.119 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:06:06.128+0000 7f349ce00640 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:06.126 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:06:06.135+0000 7f2492600640 -1 osd.5 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:06.137 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:06:06.146+0000 7fcaa8000640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-19T06:06:06.256 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.264+0000 7ff417400640 1 -- 172.21.15.17:0/1196652957 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8977 (secure 0 0 0) 0x7ff42015ae70 con 0x7ff4200ca890 2024-03-19T06:06:06.256 INFO:teuthology.misc.health.smithi017.stdout: 2024-03-19T06:06:06.256 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":15,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:05.527295+0000","last_up_change":"2024-03-19T06:06:05.527295+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:06.260 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 msgr2=0x7ff3fc06e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:06.260 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 0x7ff3fc06e050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff420153890 tx=0x7ff408007990 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 msgr2=0x7ff42014f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff410009870 tx=0x7ff410004730 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 shutdown_connections 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff420153cd0 0x7ff4201f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff4200cac70 0x7ff42014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff3fc06bb90 0x7ff3fc06e050 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 --2- 172.21.15.17:0/1196652957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4200ca890 0x7ff42014f020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:06.261 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.269+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 >> 172.21.15.17:0/1196652957 conn(0x7ff42006bd20 msgr2=0x7ff4200c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:06.262 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.270+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 shutdown_connections 2024-03-19T06:06:06.262 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:06.270+0000 7ff426000640 1 -- 172.21.15.17:0/1196652957 wait complete. 2024-03-19T06:06:06.279 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-19T06:06:13.085 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:13.291 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.300+0000 7f364f400640 1 Processor -- start 2024-03-19T06:06:13.291 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.300+0000 7f364f400640 1 -- start start 2024-03-19T06:06:13.293 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.302+0000 7f364f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f3648163480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.293 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.302+0000 7f364f400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480c5d30 con 0x7f364806f390 2024-03-19T06:06:13.293 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.302+0000 7f364f400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480c6010 con 0x7f3648151c80 2024-03-19T06:06:13.293 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.302+0000 7f364f400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364806e280 con 0x7f364806ee20 2024-03-19T06:06:13.295 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.304+0000 7f364d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f3648163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.295 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.304+0000 7f364ca00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3648151c80 0x7f36480c49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:42056/0 (socket says 172.21.15.17:42056) 2024-03-19T06:06:13.295 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.304+0000 7f364ca00640 1 -- 172.21.15.17:0/3233852980 learned_addr learned my addr 172.21.15.17:0/3233852980 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:13.301 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.310+0000 7f3647400640 1 -- 172.21.15.17:0/3233852980 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392119557 0 0) 0x7f36480c6010 con 0x7f3648151c80 2024-03-19T06:06:13.301 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.310+0000 7f3647400640 1 -- 172.21.15.17:0/3233852980 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3630003520 con 0x7f3648151c80 2024-03-19T06:06:13.302 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.311+0000 7f364d400640 1 -- 172.21.15.17:0/3233852980 >> v1:172.21.15.153:6789/0 conn(0x7f3648151c80 legacy=0x7f36480c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.302 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.311+0000 7f364d400640 1 -- 172.21.15.17:0/3233852980 >> v1:172.21.15.17:6789/0 conn(0x7f364806f390 legacy=0x7f364806e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:13.302 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.312+0000 7f364d400640 1 -- 172.21.15.17:0/3233852980 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480c62f0 con 0x7f364806ee20 2024-03-19T06:06:13.308 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.317+0000 7f364d400640 1 --2- 172.21.15.17:0/3233852980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f3648163480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364002be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=343c9c739d950cc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.319 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.328+0000 7f3647400640 1 -- 172.21.15.17:0/3233852980 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640039070 con 0x7f364806ee20 2024-03-19T06:06:13.319 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.328+0000 7f3647400640 1 -- 172.21.15.17:0/3233852980 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364002cc30 con 0x7f364806ee20 2024-03-19T06:06:13.319 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.328+0000 7f3647400640 1 -- 172.21.15.17:0/3233852980 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640034440 con 0x7f364806ee20 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 -- 172.21.15.17:0/3233852980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 msgr2=0x7f3648163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 --2- 172.21.15.17:0/3233852980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f3648163480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364002be80 comp rx=0 tx=0).stop 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 -- 172.21.15.17:0/3233852980 shutdown_connections 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 --2- 172.21.15.17:0/3233852980 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f3648163480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 -- 172.21.15.17:0/3233852980 >> 172.21.15.17:0/3233852980 conn(0x7f364806ac70 msgr2=0x7f364806b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 -- 172.21.15.17:0/3233852980 shutdown_connections 2024-03-19T06:06:13.320 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.329+0000 7f364f400640 1 -- 172.21.15.17:0/3233852980 wait complete. 2024-03-19T06:06:13.323 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.332+0000 7f364f400640 1 Processor -- start 2024-03-19T06:06:13.323 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.332+0000 7f364f400640 1 -- start start 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f36481545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364806f390 0x7f3648156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 0x7f3648152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648152060 con 0x7f3648151c80 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480c56a0 con 0x7f364806f390 2024-03-19T06:06:13.325 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.334+0000 7f364f400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36481521e0 con 0x7f364806ee20 2024-03-19T06:06:13.326 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.335+0000 7f364d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 0x7f3648152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.326 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.335+0000 7f364ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f36481545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.326 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.335+0000 7f3647e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364806f390 0x7f3648156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.326 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.335+0000 7f364d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 0x7f3648152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50858/0 (socket says 172.21.15.17:50858) 2024-03-19T06:06:13.326 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.335+0000 7f364d400640 1 -- 172.21.15.17:0/2948618969 learned_addr learned my addr 172.21.15.17:0/2948618969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:13.331 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.340+0000 7f364ca00640 1 -- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364806f390 msgr2=0x7f3648156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.331 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.340+0000 7f364ca00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364806f390 0x7f3648156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.331 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.340+0000 7f364ca00640 1 -- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 msgr2=0x7f3648152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:13.331 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.340+0000 7f364ca00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 0x7f3648152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:13.331 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.340+0000 7f364ca00640 1 -- 172.21.15.17:0/2948618969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36481ee2d0 con 0x7f364806ee20 2024-03-19T06:06:13.335 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.344+0000 7f364ca00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f36481545c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c400 tx=0x7f363c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.342 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.351+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c017070 con 0x7f364806ee20 2024-03-19T06:06:13.342 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.351+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c005ce0 con 0x7f364806ee20 2024-03-19T06:06:13.342 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.351+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0072f0 con 0x7f364806ee20 2024-03-19T06:06:13.342 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.351+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3648153ea0 con 0x7f364806ee20 2024-03-19T06:06:13.342 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.351+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3648158f00 con 0x7f364806ee20 2024-03-19T06:06:13.344 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.353+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480c7250 con 0x7f364806ee20 2024-03-19T06:06:13.653 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.662+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f363c01a070 con 0x7f364806ee20 2024-03-19T06:06:13.656 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.665+0000 7f3644c00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 0x7f362806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:13.656 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.666+0000 7f3647e00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 0x7f362806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:13.658 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.667+0000 7f3647e00640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 0x7f362806e0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36481554e0 tx=0x7f3634009060 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:13.661 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.670+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f363c05e990 con 0x7f364806ee20 2024-03-19T06:06:13.691 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.700+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f36480c7250 con 0x7f364806ee20 2024-03-19T06:06:13.926 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:13.935+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3648069f30 con 0x7f364806ee20 2024-03-19T06:06:14.109 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.118+0000 7f3644c00640 1 -- 172.21.15.17:0/2948618969 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12872 (secure 0 0 0) 0x7f3648069f30 con 0x7f364806ee20 2024-03-19T06:06:14.110 INFO:teuthology.misc.health.smithi017.stdout: 2024-03-19T06:06:14.110 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":19,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:10.875407+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.121+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 msgr2=0x7f362806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.121+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 0x7f362806e0e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f36481554e0 tx=0x7f3634009060 comp rx=0 tx=0).stop 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 msgr2=0x7f36481545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f36481545c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f363c00c400 tx=0x7f363c00c8c0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 shutdown_connections 2024-03-19T06:06:14.113 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3648151c80 0x7f3648152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f362806bc20 0x7f362806e0e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f364806f390 0x7f3648156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 --2- 172.21.15.17:0/2948618969 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f364806ee20 0x7f36481545c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 >> 172.21.15.17:0/2948618969 conn(0x7f364806ac70 msgr2=0x7f36480c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 shutdown_connections 2024-03-19T06:06:14.114 INFO:teuthology.misc.health.smithi017.stderr:2024-03-19T06:06:14.122+0000 7f364f400640 1 -- 172.21.15.17:0/2948618969 wait complete. 2024-03-19T06:06:14.129 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-19T06:06:14.130 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-19T06:06:14.130 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.130 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-19T06:06:14.130 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-03-19T06:06:14.138 INFO:tasks.ceph.mds.a:Started 2024-03-19T06:06:14.138 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.138 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-19T06:06:14.138 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-03-19T06:06:14.148 INFO:tasks.ceph.mds.c:Started 2024-03-19T06:06:14.149 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.149 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-19T06:06:14.149 DEBUG:teuthology.orchestra.run.smithi017:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-03-19T06:06:14.157 INFO:tasks.ceph.mds.e:Started 2024-03-19T06:06:14.157 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.158 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-19T06:06:14.158 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-03-19T06:06:14.166 INFO:tasks.ceph.mds.b:Started 2024-03-19T06:06:14.166 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.166 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-19T06:06:14.166 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-03-19T06:06:14.173 INFO:tasks.ceph.mds.d:Started 2024-03-19T06:06:14.174 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-03-19T06:06:14.174 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-19T06:06:14.174 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-03-19T06:06:14.180 INFO:tasks.ceph.mds.f:Started 2024-03-19T06:06:14.180 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-19T06:06:14.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.381+0000 7f85c1e00640 1 Processor -- start 2024-03-19T06:06:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.382+0000 7f85c1e00640 1 -- start start 2024-03-19T06:06:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.383+0000 7f85c1e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85bc151f70 0x7f85bc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.383+0000 7f85c1e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85bc0c1e60 0x7f85bc06e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.383+0000 7f85c1e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0c27c0 con 0x7f85bc15b1d0 2024-03-19T06:06:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.383+0000 7f85c1e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc157f30 con 0x7f85bc151f70 2024-03-19T06:06:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.383+0000 7f85c1e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc152350 con 0x7f85bc0c1e60 2024-03-19T06:06:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.384+0000 7f85baa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85bc151f70 0x7f85bc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.385+0000 7f85baa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f85bc151f70 0x7f85bc0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50882/0 (socket says 172.21.15.17:50882) 2024-03-19T06:06:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.385+0000 7f85baa00640 1 -- 172.21.15.17:0/3531573552 learned_addr learned my addr 172.21.15.17:0/3531573552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.385+0000 7f85bb400640 1 --2- 172.21.15.17:0/3531573552 >> v2:172.21.15.153:3300/0 conn(0x7f85bc0c1e60 0x7f85bc06e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.389+0000 7f85baa00640 1 -- 172.21.15.17:0/3531573552 >> v2:172.21.15.153:3300/0 conn(0x7f85bc0c1e60 msgr2=0x7f85bc06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:14.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.389+0000 7f85baa00640 1 --2- 172.21.15.17:0/3531573552 >> v2:172.21.15.153:3300/0 conn(0x7f85bc0c1e60 0x7f85bc06e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.389+0000 7f85baa00640 1 -- 172.21.15.17:0/3531573552 >> v1:172.21.15.17:6789/0 conn(0x7f85bc15b1d0 legacy=0x7f85bc1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.389+0000 7f85baa00640 1 -- 172.21.15.17:0/3531573552 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc157be0 con 0x7f85bc151f70 2024-03-19T06:06:14.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.395+0000 7f85baa00640 1 --2- 172.21.15.17:0/3531573552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc151f70 0x7f85bc0c7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85bc073010 tx=0x7f85ac02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e500840875ba40fe server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:14.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.401+0000 7f85b9600640 1 -- 172.21.15.17:0/3531573552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac02f850 con 0x7f85bc151f70 2024-03-19T06:06:14.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.402+0000 7f85b9600640 1 -- 172.21.15.17:0/3531573552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac02f9f0 con 0x7f85bc151f70 2024-03-19T06:06:14.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.402+0000 7f85b9600640 1 -- 172.21.15.17:0/3531573552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac02fdc0 con 0x7f85bc151f70 2024-03-19T06:06:14.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 -- 172.21.15.17:0/3531573552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc151f70 msgr2=0x7f85bc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3531573552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc151f70 0x7f85bc0c7760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85bc073010 tx=0x7f85ac02ba30 comp rx=0 tx=0).stop 2024-03-19T06:06:14.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 -- 172.21.15.17:0/3531573552 shutdown_connections 2024-03-19T06:06:14.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3531573552 >> v2:172.21.15.153:3300/0 conn(0x7f85bc0c1e60 0x7f85bc06e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3531573552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc151f70 0x7f85bc0c7760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 -- 172.21.15.17:0/3531573552 >> 172.21.15.17:0/3531573552 conn(0x7f85bc0c8910 msgr2=0x7f85bc0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:14.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 -- 172.21.15.17:0/3531573552 shutdown_connections 2024-03-19T06:06:14.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.403+0000 7f85c1e00640 1 -- 172.21.15.17:0/3531573552 wait complete. 2024-03-19T06:06:14.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.406+0000 7f85c1e00640 1 Processor -- start 2024-03-19T06:06:14.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.406+0000 7f85c1e00640 1 -- start start 2024-03-19T06:06:14.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85bc151f70 0x7f85bc0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85bc15b1d0 0x7f85bc1ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc15bcf0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc15ba10 con 0x7f85bc15b1d0 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.408+0000 7f85c1e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc15bfd0 con 0x7f85bc151f70 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.409+0000 7f85baa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.409+0000 7f85ba000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85bc151f70 0x7f85bc0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.409+0000 7f85baa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50898/0 (socket says 172.21.15.17:50898) 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.409+0000 7f85baa00640 1 -- 172.21.15.17:0/3274338705 learned_addr learned my addr 172.21.15.17:0/3274338705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:14.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.411+0000 7f85bb400640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85bc15b1d0 0x7f85bc1ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.415+0000 7f85baa00640 1 -- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85bc151f70 msgr2=0x7f85bc0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.415+0000 7f85baa00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85bc151f70 0x7f85bc0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.415+0000 7f85baa00640 1 -- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85bc15b1d0 msgr2=0x7f85bc1ee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.415+0000 7f85baa00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85bc15b1d0 0x7f85bc1ee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:14.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.415+0000 7f85baa00640 1 -- 172.21.15.17:0/3274338705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc1f1760 con 0x7f85bc0c1e60 2024-03-19T06:06:14.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.419+0000 7f85baa00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85ac000c00 tx=0x7f85ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.426+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac047070 con 0x7f85bc0c1e60 2024-03-19T06:06:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.426+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ac037d30 con 0x7f85bc0c1e60 2024-03-19T06:06:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.426+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0426c0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.426+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc1f19e0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.426+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc1f1fa0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.427+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc1ee1a0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.751+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f85ac04a070 con 0x7f85bc0c1e60 2024-03-19T06:06:14.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.752+0000 7f85b3400640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 0x7f859c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:14.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.753+0000 7f85ba000640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 0x7f859c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:14.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.754+0000 7f85ba000640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 0x7f859c06e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1ef210 tx=0x7f85a8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:14.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.777+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85ac081940 con 0x7f85bc0c1e60 2024-03-19T06:06:14.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.778+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f85bc1ee1a0 con 0x7f85bc0c1e60 2024-03-19T06:06:14.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:14.993+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85bc069be0 con 0x7f85bc0c1e60 2024-03-19T06:06:15.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.143+0000 7f85b3400640 1 -- 172.21.15.17:0/3274338705 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12872 (secure 0 0 0) 0x7f85ac051020 con 0x7f85bc0c1e60 2024-03-19T06:06:15.134 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:15.135 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:10.875407+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.146+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 msgr2=0x7f859c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.146+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 0x7f859c06e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85bc1ef210 tx=0x7f85a8009040 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.146+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 msgr2=0x7f85bc14acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.146+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85ac000c00 tx=0x7f85ac004730 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 shutdown_connections 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f859c06bbd0 0x7f859c06e090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85bc15b1d0 0x7f85bc1ee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f85bc151f70 0x7f85bc0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 --2- 172.21.15.17:0/3274338705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85bc0c1e60 0x7f85bc14acb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 >> 172.21.15.17:0/3274338705 conn(0x7f85bc0c8910 msgr2=0x7f85bc156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 shutdown_connections 2024-03-19T06:06:15.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.147+0000 7f85c1e00640 1 -- 172.21.15.17:0/3274338705 wait complete. 2024-03-19T06:06:15.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:06:15.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:06:15.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.355+0000 7f39be000640 1 Processor -- start 2024-03-19T06:06:15.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.355+0000 7f39be000640 1 -- start start 2024-03-19T06:06:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.356+0000 7f39be000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f39b80aff50 0x7f39b80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.356+0000 7f39be000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39b8159da0 0x7f39b8164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.356+0000 7f39be000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b80b0330 con 0x7f39b80c7f70 2024-03-19T06:06:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.356+0000 7f39be000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80c9e30 con 0x7f39b80aff50 2024-03-19T06:06:15.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.356+0000 7f39be000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b80c4340 con 0x7f39b8159da0 2024-03-19T06:06:15.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.357+0000 7f39b7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f39b80aff50 0x7f39b80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.357+0000 7f39b7e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39b8159da0 0x7f39b8164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.358+0000 7f39b7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f39b80aff50 0x7f39b80c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50904/0 (socket says 172.21.15.17:50904) 2024-03-19T06:06:15.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.358+0000 7f39b7400640 1 -- 172.21.15.17:0/4045047914 learned_addr learned my addr 172.21.15.17:0/4045047914 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.361+0000 7f39b7400640 1 -- 172.21.15.17:0/4045047914 >> v2:172.21.15.153:3300/0 conn(0x7f39b8159da0 msgr2=0x7f39b8164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.361+0000 7f39b7400640 1 --2- 172.21.15.17:0/4045047914 >> v2:172.21.15.153:3300/0 conn(0x7f39b8159da0 0x7f39b8164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.361+0000 7f39b7400640 1 -- 172.21.15.17:0/4045047914 >> v1:172.21.15.153:6789/0 conn(0x7f39b80c7f70 legacy=0x7f39b806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.361+0000 7f39b7400640 1 -- 172.21.15.17:0/4045047914 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b806fc00 con 0x7f39b80aff50 2024-03-19T06:06:15.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.378+0000 7f39b7400640 1 --2- 172.21.15.17:0/4045047914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c8c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39b80c3e20 tx=0x7f39a802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6434c6b5f8f241a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.384+0000 7f39b6000640 1 -- 172.21.15.17:0/4045047914 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8034070 con 0x7f39b80aff50 2024-03-19T06:06:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.384+0000 7f39b6000640 1 -- 172.21.15.17:0/4045047914 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8030860 con 0x7f39b80aff50 2024-03-19T06:06:15.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.384+0000 7f39b6000640 1 -- 172.21.15.17:0/4045047914 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8030c30 con 0x7f39b80aff50 2024-03-19T06:06:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 -- 172.21.15.17:0/4045047914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 msgr2=0x7f39b80c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 --2- 172.21.15.17:0/4045047914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c8c90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f39b80c3e20 tx=0x7f39a802b9a0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 -- 172.21.15.17:0/4045047914 shutdown_connections 2024-03-19T06:06:15.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 --2- 172.21.15.17:0/4045047914 >> v2:172.21.15.153:3300/0 conn(0x7f39b8159da0 0x7f39b8164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 --2- 172.21.15.17:0/4045047914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c8c90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 -- 172.21.15.17:0/4045047914 >> 172.21.15.17:0/4045047914 conn(0x7f39b806b260 msgr2=0x7f39b8066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:15.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.385+0000 7f39be000640 1 -- 172.21.15.17:0/4045047914 shutdown_connections 2024-03-19T06:06:15.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.386+0000 7f39be000640 1 -- 172.21.15.17:0/4045047914 wait complete. 2024-03-19T06:06:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.388+0000 7f39be000640 1 Processor -- start 2024-03-19T06:06:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.388+0000 7f39be000640 1 -- start start 2024-03-19T06:06:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39b80c7f70 0x7f39b80b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39b8159da0 0x7f39b80aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80c98b0 con 0x7f39b80aff50 2024-03-19T06:06:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b80c45a0 con 0x7f39b8159da0 2024-03-19T06:06:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.389+0000 7f39be000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b806f920 con 0x7f39b80c7f70 2024-03-19T06:06:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.390+0000 7f39b7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.391+0000 7f39b7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50910/0 (socket says 172.21.15.17:50910) 2024-03-19T06:06:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.391+0000 7f39b7400640 1 -- 172.21.15.17:0/1314833806 learned_addr learned my addr 172.21.15.17:0/1314833806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.391+0000 7f39b7e00640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39b8159da0 0x7f39b80aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.391+0000 7f39b6a00640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39b80c7f70 0x7f39b80b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.396+0000 7f39b7400640 1 -- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39b80c7f70 msgr2=0x7f39b80b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.396+0000 7f39b7400640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39b80c7f70 0x7f39b80b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.396+0000 7f39b7400640 1 -- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39b8159da0 msgr2=0x7f39b80aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.396+0000 7f39b7400640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39b8159da0 0x7f39b80aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:15.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.396+0000 7f39b7400640 1 -- 172.21.15.17:0/1314833806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80c4f50 con 0x7f39b80aff50 2024-03-19T06:06:15.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.400+0000 7f39b7400640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009960 tx=0x7f39a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.406+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8048070 con 0x7f39b80aff50 2024-03-19T06:06:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.406+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8030660 con 0x7f39b80aff50 2024-03-19T06:06:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.406+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8034040 con 0x7f39b80aff50 2024-03-19T06:06:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.406+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b80c5230 con 0x7f39b80aff50 2024-03-19T06:06:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.406+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b81f0a60 con 0x7f39b80aff50 2024-03-19T06:06:15.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.408+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8069be0 con 0x7f39b80aff50 2024-03-19T06:06:15.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.717+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f39a804b070 con 0x7f39b80aff50 2024-03-19T06:06:15.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.718+0000 7f39af400640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 0x7f399806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:15.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.718+0000 7f39b6a00640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 0x7f399806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:15.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.719+0000 7f39b6a00640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 0x7f399806e0e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39b81f41d0 tx=0x7f39a4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.742+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39a8030810 con 0x7f39b80aff50 2024-03-19T06:06:15.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:15.742+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f39a8052080 con 0x7f39b80aff50 2024-03-19T06:06:16.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.135+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39b80c5400 con 0x7f39b80aff50 2024-03-19T06:06:16.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.172+0000 7f39af400640 1 -- 172.21.15.17:0/1314833806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39a807b170 con 0x7f39b80aff50 2024-03-19T06:06:16.163 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:06:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 msgr2=0x7f399806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 0x7f399806e0e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f39b81f41d0 tx=0x7f39a4009040 comp rx=0 tx=0).stop 2024-03-19T06:06:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 msgr2=0x7f39b80c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009960 tx=0x7f39a8004730 comp rx=0 tx=0).stop 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 shutdown_connections 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f399806bc20 0x7f399806e0e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39b8159da0 0x7f39b80aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f39b80c7f70 0x7f39b80b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 --2- 172.21.15.17:0/1314833806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39b80aff50 0x7f39b80c4850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.176+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 >> 172.21.15.17:0/1314833806 conn(0x7f39b806b260 msgr2=0x7f39b80adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.177+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 shutdown_connections 2024-03-19T06:06:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.177+0000 7f39be000640 1 -- 172.21.15.17:0/1314833806 wait complete. 2024-03-19T06:06:16.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.385+0000 7f3637200640 1 Processor -- start 2024-03-19T06:06:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.385+0000 7f3637200640 1 -- start start 2024-03-19T06:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.386+0000 7f3637200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.386+0000 7f3637200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36300ca140 0x7f363006c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.386+0000 7f3637200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363015d1d0 con 0x7f36300ca580 2024-03-19T06:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.386+0000 7f3637200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36300cac30 con 0x7f36300ca140 2024-03-19T06:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.386+0000 7f3637200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363015d450 con 0x7f3630153d90 2024-03-19T06:06:16.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.388+0000 7f362fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.388+0000 7f362f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36300ca140 0x7f363006c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.388+0000 7f362fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:56974/0 (socket says 172.21.15.17:56974) 2024-03-19T06:06:16.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.388+0000 7f362fe00640 1 -- 172.21.15.17:0/3894145140 learned_addr learned my addr 172.21.15.17:0/3894145140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:16.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.392+0000 7f362fe00640 1 -- 172.21.15.17:0/3894145140 >> v2:172.21.15.153:3300/0 conn(0x7f36300ca140 msgr2=0x7f363006c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:16.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.392+0000 7f362fe00640 1 --2- 172.21.15.17:0/3894145140 >> v2:172.21.15.153:3300/0 conn(0x7f36300ca140 0x7f363006c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.392+0000 7f362fe00640 1 -- 172.21.15.17:0/3894145140 >> v1:172.21.15.153:6789/0 conn(0x7f36300ca580 legacy=0x7f36300cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.392+0000 7f362fe00640 1 -- 172.21.15.17:0/3894145140 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363015d730 con 0x7f3630153d90 2024-03-19T06:06:16.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.397+0000 7f362fe00640 1 --2- 172.21.15.17:0/3894145140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36300cadb0 tx=0x7f362002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64b18d2ff6ce45a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:16.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.406+0000 7f362ea00640 1 -- 172.21.15.17:0/3894145140 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620034070 con 0x7f3630153d90 2024-03-19T06:06:16.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.406+0000 7f362ea00640 1 -- 172.21.15.17:0/3894145140 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620030840 con 0x7f3630153d90 2024-03-19T06:06:16.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.406+0000 7f362ea00640 1 -- 172.21.15.17:0/3894145140 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620030c10 con 0x7f3630153d90 2024-03-19T06:06:16.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 -- 172.21.15.17:0/3894145140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 msgr2=0x7f363015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 --2- 172.21.15.17:0/3894145140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36300cadb0 tx=0x7f362002b980 comp rx=0 tx=0).stop 2024-03-19T06:06:16.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 -- 172.21.15.17:0/3894145140 shutdown_connections 2024-03-19T06:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 --2- 172.21.15.17:0/3894145140 >> v2:172.21.15.153:3300/0 conn(0x7f36300ca140 0x7f363006c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 --2- 172.21.15.17:0/3894145140 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3630153d90 0x7f363015a7d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 -- 172.21.15.17:0/3894145140 >> 172.21.15.17:0/3894145140 conn(0x7f3630066e10 msgr2=0x7f363006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 -- 172.21.15.17:0/3894145140 shutdown_connections 2024-03-19T06:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.407+0000 7f3637200640 1 -- 172.21.15.17:0/3894145140 wait complete. 2024-03-19T06:06:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.409+0000 7f3637200640 1 Processor -- start 2024-03-19T06:06:16.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.409+0000 7f3637200640 1 -- start start 2024-03-19T06:06:16.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300ca140 0x7f36301f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36300ca580 0x7f36301e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363015dfd0 con 0x7f3630153d90 2024-03-19T06:06:16.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363015dcf0 con 0x7f36300ca140 2024-03-19T06:06:16.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.410+0000 7f3637200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36300cb7d0 con 0x7f36300ca580 2024-03-19T06:06:16.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.412+0000 7f3635200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.412+0000 7f3635200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50918/0 (socket says 172.21.15.17:50918) 2024-03-19T06:06:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.412+0000 7f3635200640 1 -- 172.21.15.17:0/2398006754 learned_addr learned my addr 172.21.15.17:0/2398006754 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.412+0000 7f362f400640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36300ca580 0x7f36301e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.412+0000 7f362fe00640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300ca140 0x7f36301f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.417+0000 7f3635200640 1 -- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36300ca580 msgr2=0x7f36301e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.417+0000 7f3635200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36300ca580 0x7f36301e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.418+0000 7f3635200640 1 -- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300ca140 msgr2=0x7f36301f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.418+0000 7f3635200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300ca140 0x7f36301f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:16.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.418+0000 7f3635200640 1 -- 172.21.15.17:0/2398006754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36301e4820 con 0x7f3630153d90 2024-03-19T06:06:16.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.421+0000 7f3635200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f362800c7d0 tx=0x7f362800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.428+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628003b70 con 0x7f3630153d90 2024-03-19T06:06:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.428+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3628003d30 con 0x7f3630153d90 2024-03-19T06:06:16.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.428+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800aa30 con 0x7f3630153d90 2024-03-19T06:06:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.429+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363014f380 con 0x7f3630153d90 2024-03-19T06:06:16.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.429+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36301efb10 con 0x7f3630153d90 2024-03-19T06:06:16.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.430+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3630069be0 con 0x7f3630153d90 2024-03-19T06:06:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.465+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f362800abd0 con 0x7f3630153d90 2024-03-19T06:06:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.466+0000 7f3627e00640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 0x7f361006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:16.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.466+0000 7f362fe00640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 0x7f361006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:16.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.467+0000 7f362fe00640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 0x7f361006e0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3620036000 tx=0x7f362003b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:16.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.470+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3628057820 con 0x7f3630153d90 2024-03-19T06:06:16.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:16.779+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f363015d1d0 con 0x7f3630153d90 2024-03-19T06:06:17.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.132+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36300b2300 con 0x7f3630153d90 2024-03-19T06:06:17.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.149+0000 7f3627e00640 1 -- 172.21.15.17:0/2398006754 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f3628059780 con 0x7f3630153d90 2024-03-19T06:06:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:17.140 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-19T06:06:17.140 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-03-19T06:06:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 msgr2=0x7f361006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 0x7f361006e0e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3620036000 tx=0x7f362003b040 comp rx=0 tx=0).stop 2024-03-19T06:06:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 msgr2=0x7f363015bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:17.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f362800c7d0 tx=0x7f362800cc90 comp rx=0 tx=0).stop 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 shutdown_connections 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3630153d90 0x7f363015bac0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36300ca580 0x7f36301e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f361006bc20 0x7f361006e0e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 --2- 172.21.15.17:0/2398006754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36300ca140 0x7f36301f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 >> 172.21.15.17:0/2398006754 conn(0x7f3630066e10 msgr2=0x7f36300ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 shutdown_connections 2024-03-19T06:06:17.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:17.152+0000 7f3637200640 1 -- 172.21.15.17:0/2398006754 wait complete. 2024-03-19T06:06:17.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:06:17.821 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:06:19.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:19.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.360+0000 7fb30f200640 1 Processor -- start 2024-03-19T06:06:19.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.360+0000 7fb30f200640 1 -- start start 2024-03-19T06:06:19.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.361+0000 7fb30f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb308151d10 0x7fb3080c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.361+0000 7fb30f200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb3080c2c90 0x7fb3080c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.361+0000 7fb30f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3080c84d0 con 0x7fb3081584e0 2024-03-19T06:06:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.361+0000 7fb30f200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3080c96f0 con 0x7fb3080c2c90 2024-03-19T06:06:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.361+0000 7fb30f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080c9130 con 0x7fb308151d10 2024-03-19T06:06:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.362+0000 7fb307400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb3081584e0 0x7fb30815b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36124/0 (socket says 172.21.15.17:36124) 2024-03-19T06:06:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.363+0000 7fb307400640 1 -- 172.21.15.17:0/1353824298 learned_addr learned my addr 172.21.15.17:0/1353824298 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:19.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.364+0000 7fb30d200640 1 --2- 172.21.15.17:0/1353824298 >> v2:172.21.15.17:3300/0 conn(0x7fb3080c2c90 0x7fb3080c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.365+0000 7fb307e00640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb308151d10 0x7fb3080c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.368+0000 7fb306a00640 1 -- 172.21.15.17:0/1353824298 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925696880 0 0) 0x7fb3080c84d0 con 0x7fb3081584e0 2024-03-19T06:06:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.368+0000 7fb306a00640 1 -- 172.21.15.17:0/1353824298 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003520 con 0x7fb3081584e0 2024-03-19T06:06:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.371+0000 7fb30d200640 1 -- 172.21.15.17:0/1353824298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb308151d10 msgr2=0x7fb3080c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.371+0000 7fb30d200640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb308151d10 0x7fb3080c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.371+0000 7fb30d200640 1 -- 172.21.15.17:0/1353824298 >> v1:172.21.15.17:6789/0 conn(0x7fb3081584e0 legacy=0x7fb30815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:19.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.371+0000 7fb30d200640 1 -- 172.21.15.17:0/1353824298 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3080c9410 con 0x7fb3080c2c90 2024-03-19T06:06:19.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.378+0000 7fb30d200640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb3080c30e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3080c9870 tx=0x7fb30002bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfa2f59dc8e856e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.385+0000 7fb306a00640 1 -- 172.21.15.17:0/1353824298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300039070 con 0x7fb3080c2c90 2024-03-19T06:06:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.385+0000 7fb306a00640 1 -- 172.21.15.17:0/1353824298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30002cb20 con 0x7fb3080c2c90 2024-03-19T06:06:19.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.385+0000 7fb306a00640 1 -- 172.21.15.17:0/1353824298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300034440 con 0x7fb3080c2c90 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 -- 172.21.15.17:0/1353824298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 msgr2=0x7fb3080c30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb3080c30e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3080c9870 tx=0x7fb30002bd70 comp rx=0 tx=0).stop 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 -- 172.21.15.17:0/1353824298 shutdown_connections 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb3080c30e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 --2- 172.21.15.17:0/1353824298 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb308151d10 0x7fb3080c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 -- 172.21.15.17:0/1353824298 >> 172.21.15.17:0/1353824298 conn(0x7fb308070930 msgr2=0x7fb308070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:19.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 -- 172.21.15.17:0/1353824298 shutdown_connections 2024-03-19T06:06:19.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.386+0000 7fb30f200640 1 -- 172.21.15.17:0/1353824298 wait complete. 2024-03-19T06:06:19.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.389+0000 7fb30f200640 1 Processor -- start 2024-03-19T06:06:19.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.389+0000 7fb30f200640 1 -- start start 2024-03-19T06:06:19.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb308151d10 0x7fb30806c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3081584e0 0x7fb30806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081520f0 con 0x7fb3080c2c90 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30815b460 con 0x7fb308151d10 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.390+0000 7fb30f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb308158900 con 0x7fb3081584e0 2024-03-19T06:06:19.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.391+0000 7fb307e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.392+0000 7fb307e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50934/0 (socket says 172.21.15.17:50934) 2024-03-19T06:06:19.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.392+0000 7fb307e00640 1 -- 172.21.15.17:0/2378827911 learned_addr learned my addr 172.21.15.17:0/2378827911 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:19.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.392+0000 7fb30d200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3081584e0 0x7fb30806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.393+0000 7fb307400640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb308151d10 0x7fb30806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.397+0000 7fb307e00640 1 -- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3081584e0 msgr2=0x7fb30806ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.397+0000 7fb307e00640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3081584e0 0x7fb30806ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.397+0000 7fb307e00640 1 -- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb308151d10 msgr2=0x7fb30806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:19.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.397+0000 7fb307e00640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb308151d10 0x7fb30806c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:19.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.397+0000 7fb307e00640 1 -- 172.21.15.17:0/2378827911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3080b3050 con 0x7fb3080c2c90 2024-03-19T06:06:19.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.401+0000 7fb307e00640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800e9e0 tx=0x7fb2f800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.407+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8017070 con 0x7fb3080c2c90 2024-03-19T06:06:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.407+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800c970 con 0x7fb3080c2c90 2024-03-19T06:06:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.407+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800cd60 con 0x7fb3080c2c90 2024-03-19T06:06:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.407+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30806c440 con 0x7fb3080c2c90 2024-03-19T06:06:19.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.407+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3080b1300 con 0x7fb3080c2c90 2024-03-19T06:06:19.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.409+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308069be0 con 0x7fb3080c2c90 2024-03-19T06:06:19.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.715+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb2f801a070 con 0x7fb3080c2c90 2024-03-19T06:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.716+0000 7fb2ffe00640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 0x7fb2e806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.716+0000 7fb307400640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 0x7fb2e806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.717+0000 7fb307400640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 0x7fb2e806e0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3081e16d0 tx=0x7fb2f4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.739+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2f805f9b0 con 0x7fb3080c2c90 2024-03-19T06:06:19.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:19.739+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb2f8059690 con 0x7fb3080c2c90 2024-03-19T06:06:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.008+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3080c86d0 con 0x7fb3080c2c90 2024-03-19T06:06:20.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.017+0000 7fb2ffe00640 1 -- 172.21.15.17:0/2378827911 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7fb2f805d730 con 0x7fb3080c2c90 2024-03-19T06:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-19T06:06:20.009 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 1 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.019+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 msgr2=0x7fb2e806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.019+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 0x7fb2e806e0e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3081e16d0 tx=0x7fb2f4009040 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.019+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 msgr2=0x7fb30814ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.019+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800e9e0 tx=0x7fb2f800eea0 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 shutdown_connections 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb3081584e0 0x7fb30806ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb2e806bc20 0x7fb2e806e0e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb308151d10 0x7fb30806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 --2- 172.21.15.17:0/2378827911 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3080c2c90 0x7fb30814ffb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:20.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 >> 172.21.15.17:0/2378827911 conn(0x7fb308070930 msgr2=0x7fb30814ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 shutdown_connections 2024-03-19T06:06:20.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:20.020+0000 7fb30f200640 1 -- 172.21.15.17:0/2378827911 wait complete. 2024-03-19T06:06:21.184 INFO:tasks.ceph.mds.d.smithi153.stdout:starting mds.d at 2024-03-19T06:06:21.224 INFO:tasks.ceph.mds.f.smithi153.stdout:starting mds.f at 2024-03-19T06:06:21.300 INFO:tasks.ceph.mds.b.smithi153.stdout:starting mds.b at 2024-03-19T06:06:21.383 INFO:tasks.ceph.mds.e.smithi017.stdout:starting mds.e at 2024-03-19T06:06:21.430 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-03-19T06:06:21.569 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-19T06:06:22.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.249+0000 7f022f200640 1 Processor -- start 2024-03-19T06:06:22.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.249+0000 7f022f200640 1 -- start start 2024-03-19T06:06:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.250+0000 7f022f200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 0x7f02300ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.250+0000 7f022f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 0x7f023006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.251+0000 7f022f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300c9a30 con 0x7f023006de10 2024-03-19T06:06:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.251+0000 7f022f200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300c7b20 con 0x7f0230153c20 2024-03-19T06:06:22.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.251+0000 7f022f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300c9470 con 0x7f02300c88a0 2024-03-19T06:06:22.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.253+0000 7f022de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 0x7f02300ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:22.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.253+0000 7f022d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 0x7f023006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:22.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.254+0000 7f022de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 0x7f02300ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:34064/0 (socket says 172.21.15.17:34064) 2024-03-19T06:06:22.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.254+0000 7f022de00640 1 -- 172.21.15.17:0/4022812694 learned_addr learned my addr 172.21.15.17:0/4022812694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.260+0000 7f022d400640 1 -- 172.21.15.17:0/4022812694 >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 msgr2=0x7f02300ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.260+0000 7f022d400640 1 --2- 172.21.15.17:0/4022812694 >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 0x7f02300ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.260+0000 7f022d400640 1 -- 172.21.15.17:0/4022812694 >> v1:172.21.15.17:6789/0 conn(0x7f023006de10 legacy=0x7f023015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:22.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.260+0000 7f022d400640 1 -- 172.21.15.17:0/4022812694 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300c9750 con 0x7f02300c88a0 2024-03-19T06:06:22.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.266+0000 7f022d400640 1 --2- 172.21.15.17:0/4022812694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 0x7f023006d8d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f021c0097a0 tx=0x7f021c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd526e43e84481a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:22.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.276+0000 7f022ca00640 1 -- 172.21.15.17:0/4022812694 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c035020 con 0x7f02300c88a0 2024-03-19T06:06:22.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.276+0000 7f022ca00640 1 -- 172.21.15.17:0/4022812694 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c031810 con 0x7f02300c88a0 2024-03-19T06:06:22.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.276+0000 7f022ca00640 1 -- 172.21.15.17:0/4022812694 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c031be0 con 0x7f02300c88a0 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 -- 172.21.15.17:0/4022812694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 msgr2=0x7f023006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 --2- 172.21.15.17:0/4022812694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 0x7f023006d8d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f021c0097a0 tx=0x7f021c02b8b0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 -- 172.21.15.17:0/4022812694 shutdown_connections 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 --2- 172.21.15.17:0/4022812694 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f02300c88a0 0x7f023006d8d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 --2- 172.21.15.17:0/4022812694 >> v2:172.21.15.153:3300/0 conn(0x7f0230153c20 0x7f02300ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 -- 172.21.15.17:0/4022812694 >> 172.21.15.17:0/4022812694 conn(0x7f02300719f0 msgr2=0x7f0230071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 -- 172.21.15.17:0/4022812694 shutdown_connections 2024-03-19T06:06:22.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.277+0000 7f022f200640 1 -- 172.21.15.17:0/4022812694 wait complete. 2024-03-19T06:06:22.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.279+0000 7f022f200640 1 Processor -- start 2024-03-19T06:06:22.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.279+0000 7f022f200640 1 -- start start 2024-03-19T06:06:22.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0230153c20 0x7f02301efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0230150570 0x7f02300c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300c6300 con 0x7f0230153c20 2024-03-19T06:06:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300c77b0 con 0x7f0230150570 2024-03-19T06:06:22.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.280+0000 7f022f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300c6480 con 0x7f023006de10 2024-03-19T06:06:22.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.284+0000 7f022de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.285+0000 7f022de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49942/0 (socket says 172.21.15.17:49942) 2024-03-19T06:06:22.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.285+0000 7f022de00640 1 -- 172.21.15.17:0/1054204785 learned_addr learned my addr 172.21.15.17:0/1054204785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.298+0000 7f022de00640 1 -- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0230150570 msgr2=0x7f02300c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.299+0000 7f022de00640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0230150570 0x7f02300c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.299+0000 7f022de00640 1 -- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0230153c20 msgr2=0x7f02301efdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.299+0000 7f022de00640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0230153c20 0x7f02301efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:22.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.299+0000 7f022de00640 1 -- 172.21.15.17:0/1054204785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02301f0300 con 0x7f023006de10 2024-03-19T06:06:22.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.305+0000 7f022de00640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f022000e840 tx=0x7f022000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.314+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220017070 con 0x7f023006de10 2024-03-19T06:06:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.314+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022000c8e0 con 0x7f023006de10 2024-03-19T06:06:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.314+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000ccd0 con 0x7f023006de10 2024-03-19T06:06:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.315+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0230150c80 con 0x7f023006de10 2024-03-19T06:06:22.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.315+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02301ef5c0 con 0x7f023006de10 2024-03-19T06:06:22.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.317+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02301f3830 con 0x7f023006de10 2024-03-19T06:06:22.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.708+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f022001a070 con 0x7f023006de10 2024-03-19T06:06:22.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.710+0000 7f0226000640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 0x7f021006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:22.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.711+0000 7f022d400640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 0x7f021006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.712+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0220057590 con 0x7f023006de10 2024-03-19T06:06:22.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.713+0000 7f022d400640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 0x7f021006e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f021c036000 tx=0x7f021c030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:22.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.735+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f02301f3830 con 0x7f023006de10 2024-03-19T06:06:22.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:22.997+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02301ef3b0 con 0x7f023006de10 2024-03-19T06:06:23.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.320+0000 7f0226000640 1 -- 172.21.15.17:0/1054204785 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f0220059bf0 con 0x7f023006de10 2024-03-19T06:06:23.312 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:23.312 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-19T06:06:23.312 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 msgr2=0x7f021006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 0x7f021006e0e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f021c036000 tx=0x7f021c030000 comp rx=0 tx=0).stop 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 msgr2=0x7f023014b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f022000e840 tx=0x7f022000ed00 comp rx=0 tx=0).stop 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 shutdown_connections 2024-03-19T06:06:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f021006bc20 0x7f021006e0e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0230150570 0x7f02300c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0230153c20 0x7f02301efdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 --2- 172.21.15.17:0/1054204785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f023006de10 0x7f023014b030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 >> 172.21.15.17:0/1054204785 conn(0x7f02300719f0 msgr2=0x7f023014dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 shutdown_connections 2024-03-19T06:06:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:23.324+0000 7f022f200640 1 -- 172.21.15.17:0/1054204785 wait complete. 2024-03-19T06:06:25.339 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:25.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.566+0000 7fb9eec00640 1 Processor -- start 2024-03-19T06:06:25.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.567+0000 7fb9eec00640 1 -- start start 2024-03-19T06:06:25.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.568+0000 7fb9eec00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9e8157f50 0x7fb9e80cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.568+0000 7fb9eec00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e806bb70 con 0x7fb9e81518c0 2024-03-19T06:06:25.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.568+0000 7fb9eec00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80c6df0 con 0x7fb9e80c8460 2024-03-19T06:06:25.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.568+0000 7fb9eec00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80c9540 con 0x7fb9e8157f50 2024-03-19T06:06:25.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.569+0000 7fb9ed800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb9e81518c0 0x7fb9e806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56742/0 (socket says 172.21.15.17:56742) 2024-03-19T06:06:25.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.569+0000 7fb9ed800640 1 -- 172.21.15.17:0/1308915597 learned_addr learned my addr 172.21.15.17:0/1308915597 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:25.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.571+0000 7fb9ee200640 1 --2- 172.21.15.17:0/1308915597 >> v2:172.21.15.153:3300/0 conn(0x7fb9e8157f50 0x7fb9e80cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.572+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434367567 0 0) 0x7fb9e806bb70 con 0x7fb9e81518c0 2024-03-19T06:06:25.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.572+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003520 con 0x7fb9e81518c0 2024-03-19T06:06:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1408946528 0 0) 0x7fb9cc003520 con 0x7fb9e81518c0 2024-03-19T06:06:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 >> v2:172.21.15.153:3300/0 conn(0x7fb9e8157f50 msgr2=0x7fb9e80cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/1308915597 >> v2:172.21.15.153:3300/0 conn(0x7fb9e8157f50 0x7fb9e80cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 >> v1:172.21.15.153:6789/0 conn(0x7fb9e80c8460 legacy=0x7fb9e8157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:25.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80c9820 con 0x7fb9e81518c0 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fb9d8001670 con 0x7fb9e81518c0 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 >> v1:172.21.15.17:6789/0 conn(0x7fb9e81518c0 legacy=0x7fb9e806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9cc003a00 0x7fb9cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9cc0051c0 0x7fb9cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c9540 con 0x7fb9cc004800 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00c0a0 con 0x7fb9cc003a00 2024-03-19T06:06:25.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.576+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00c2a0 con 0x7fb9cc0051c0 2024-03-19T06:06:25.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.578+0000 7fb9ee200640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9cc0051c0 0x7fb9cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.582+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ece00640 1 -- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9cc0051c0 msgr2=0x7fb9cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9cc0051c0 0x7fb9cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ece00640 1 -- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9cc003a00 msgr2=0x7fb9cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9cc003a00 0x7fb9cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ece00640 1 -- 172.21.15.17:0/1308915597 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc003520 con 0x7fb9cc004800 2024-03-19T06:06:25.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.585+0000 7fb9ee200640 1 -- 172.21.15.17:0/1308915597 reap_dead start 2024-03-19T06:06:25.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.588+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9cc004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001750 tx=0x7fb9cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdbfc062990fc4b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:25.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.592+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4001370 con 0x7fb9cc004800 2024-03-19T06:06:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.593+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d40052d0 con 0x7fb9cc004800 2024-03-19T06:06:25.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.593+0000 7fb9e7e00640 1 -- 172.21.15.17:0/1308915597 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4003830 con 0x7fb9cc004800 2024-03-19T06:06:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.594+0000 7fb9eec00640 1 -- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 msgr2=0x7fb9cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.594+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9cc004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4001750 tx=0x7fb9cc005830 comp rx=0 tx=0).stop 2024-03-19T06:06:25.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.594+0000 7fb9eec00640 1 -- 172.21.15.17:0/1308915597 shutdown_connections 2024-03-19T06:06:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.594+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1308915597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9cc004c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.594+0000 7fb9eec00640 1 -- 172.21.15.17:0/1308915597 >> 172.21.15.17:0/1308915597 conn(0x7fb9e80719f0 msgr2=0x7fb9e8071dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.595+0000 7fb9eec00640 1 -- 172.21.15.17:0/1308915597 shutdown_connections 2024-03-19T06:06:25.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.595+0000 7fb9eec00640 1 -- 172.21.15.17:0/1308915597 wait complete. 2024-03-19T06:06:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.597+0000 7fb9eec00640 1 Processor -- start 2024-03-19T06:06:25.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.597+0000 7fb9eec00640 1 -- start start 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e8157ae0 0x7fb9e8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e80ca6b0 0x7fb9e81f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8151ca0 con 0x7fb9cc004800 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e806b0b0 con 0x7fb9e8157ae0 2024-03-19T06:06:25.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.598+0000 7fb9eec00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80c69b0 con 0x7fb9e80ca6b0 2024-03-19T06:06:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.599+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.599+0000 7fb9ed800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51640/0 (socket says 172.21.15.17:51640) 2024-03-19T06:06:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.599+0000 7fb9ed800640 1 -- 172.21.15.17:0/1902839359 learned_addr learned my addr 172.21.15.17:0/1902839359 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:25.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.600+0000 7fb9ee200640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e80ca6b0 0x7fb9e81f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e8157ae0 0x7fb9e8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ed800640 1 -- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e80ca6b0 msgr2=0x7fb9e81f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ed800640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e80ca6b0 0x7fb9e81f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ed800640 1 -- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e8157ae0 msgr2=0x7fb9e8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ed800640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e8157ae0 0x7fb9e8156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:25.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.603+0000 7fb9ed800640 1 -- 172.21.15.17:0/1902839359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8157640 con 0x7fb9cc004800 2024-03-19T06:06:25.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.606+0000 7fb9ed800640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c760 tx=0x7fb9d800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.611+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8018070 con 0x7fb9cc004800 2024-03-19T06:06:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.611+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80072d0 con 0x7fb9cc004800 2024-03-19T06:06:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.611+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d80047e0 con 0x7fb9cc004800 2024-03-19T06:06:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.611+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80cb3f0 con 0x7fb9cc004800 2024-03-19T06:06:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.611+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80cb9b0 con 0x7fb9cc004800 2024-03-19T06:06:25.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.612+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e804f050 con 0x7fb9cc004800 2024-03-19T06:06:25.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.930+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb9d801b070 con 0x7fb9cc004800 2024-03-19T06:06:25.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.931+0000 7fb9e5600640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 0x7fb9c806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:25.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.932+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 0x7fb9c806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:25.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.934+0000 7fb9ece00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 0x7fb9c806e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4033000 tx=0x7fb9d4009030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.997+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9d80568c0 con 0x7fb9cc004800 2024-03-19T06:06:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:25.998+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb9d8022020 con 0x7fb9cc004800 2024-03-19T06:06:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.259+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9e806b6b0 con 0x7fb9cc004800 2024-03-19T06:06:26.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.323+0000 7fb9e5600640 1 -- 172.21.15.17:0/1902839359 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+5277 (secure 0 0 0) 0x7fb9d8058820 con 0x7fb9cc004800 2024-03-19T06:06:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:26.314 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4}],"filesystems":[]} 2024-03-19T06:06:26.315 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 4 2024-03-19T06:06:26.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.326+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 msgr2=0x7fb9c806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.326+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 0x7fb9c806e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4033000 tx=0x7fb9d4009030 comp rx=0 tx=0).stop 2024-03-19T06:06:26.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 msgr2=0x7fb9e81f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800c760 tx=0x7fb9d800cc20 comp rx=0 tx=0).stop 2024-03-19T06:06:26.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 shutdown_connections 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb9e80ca6b0 0x7fb9e81f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb9c806bc20 0x7fb9c806e0e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9e8157ae0 0x7fb9e8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 --2- 172.21.15.17:0/1902839359 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9cc004800 0x7fb9e81f0140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 >> 172.21.15.17:0/1902839359 conn(0x7fb9e80719f0 msgr2=0x7fb9e814fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 shutdown_connections 2024-03-19T06:06:26.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.327+0000 7fb9eec00640 1 -- 172.21.15.17:0/1902839359 wait complete. 2024-03-19T06:06:26.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:26.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.553+0000 7f10ac800640 1 Processor -- start 2024-03-19T06:06:26.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.553+0000 7f10ac800640 1 -- start start 2024-03-19T06:06:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.555+0000 7f10ac800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f10a415b1d0 0x7f10a40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.555+0000 7f10ac800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40c27c0 con 0x7f10a40c1e60 2024-03-19T06:06:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.555+0000 7f10ac800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a4157be0 con 0x7f10a4151f70 2024-03-19T06:06:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.555+0000 7f10ac800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a4157f30 con 0x7f10a415b1d0 2024-03-19T06:06:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.557+0000 7f10a9e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f10a4151f70 0x7f10a41583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:44306/0 (socket says 172.21.15.17:44306) 2024-03-19T06:06:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.557+0000 7f10a9e00640 1 -- 172.21.15.17:0/3206345311 learned_addr learned my addr 172.21.15.17:0/3206345311 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.564+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24864197 0 0) 0x7f10a4157be0 con 0x7f10a4151f70 2024-03-19T06:06:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.564+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108c003520 con 0x7f10a4151f70 2024-03-19T06:06:26.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.573+0000 7f10a9400640 1 --2- 172.21.15.17:0/3206345311 >> v2:172.21.15.17:3300/0 conn(0x7f10a415b1d0 0x7f10a40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.1 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701256037 0 0) 0x7f108c003520 con 0x7f10a4151f70 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 >> v2:172.21.15.17:3300/0 conn(0x7f10a415b1d0 msgr2=0x7f10a40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 --2- 172.21.15.17:0/3206345311 >> v2:172.21.15.17:3300/0 conn(0x7f10a415b1d0 0x7f10a40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 >> v1:172.21.15.17:6789/0 conn(0x7f10a40c1e60 legacy=0x7f10a406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a415b730 con 0x7f10a4151f70 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.1 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f1098001670 con 0x7f10a4151f70 2024-03-19T06:06:26.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 >> v1:172.21.15.153:6789/0 conn(0x7f10a4151f70 legacy=0x7f10a41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 0x7f108c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f108c004800 0x7f108c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c005310 0x7f108c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4157f30 con 0x7f108c003a00 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c00c240 con 0x7f108c005310 2024-03-19T06:06:26.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.575+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c00c440 con 0x7f108c004800 2024-03-19T06:06:26.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.577+0000 7f10a9400640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f108c004800 0x7f108c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.578+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 0x7f108c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10a9e00640 1 -- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f108c004800 msgr2=0x7f108c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f108c004800 0x7f108c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10a9e00640 1 -- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c005310 msgr2=0x7f108c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c005310 0x7f108c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10a9e00640 1 -- 172.21.15.17:0/3206345311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c003520 con 0x7f108c003a00 2024-03-19T06:06:26.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.583+0000 7f10aa800640 1 -- 172.21.15.17:0/3206345311 reap_dead start 2024-03-19T06:06:26.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.587+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 0x7f108c003e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f109800c190 tx=0x7f108c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9dafdea295b97b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.592+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098007c60 con 0x7f108c003a00 2024-03-19T06:06:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.592+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098030070 con 0x7f108c003a00 2024-03-19T06:06:26.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.592+0000 7f10a8a00640 1 -- 172.21.15.17:0/3206345311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098005d90 con 0x7f108c003a00 2024-03-19T06:06:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 -- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 msgr2=0x7f108c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 0x7f108c003e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f109800c190 tx=0x7f108c005830 comp rx=0 tx=0).stop 2024-03-19T06:06:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 -- 172.21.15.17:0/3206345311 shutdown_connections 2024-03-19T06:06:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 --2- 172.21.15.17:0/3206345311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f108c003a00 0x7f108c003e40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 -- 172.21.15.17:0/3206345311 >> 172.21.15.17:0/3206345311 conn(0x7f10a40c8910 msgr2=0x7f10a40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.593+0000 7f10ac800640 1 -- 172.21.15.17:0/3206345311 shutdown_connections 2024-03-19T06:06:26.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.594+0000 7f10ac800640 1 -- 172.21.15.17:0/3206345311 wait complete. 2024-03-19T06:06:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.597+0000 7f10ac800640 1 Processor -- start 2024-03-19T06:06:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.597+0000 7f10ac800640 1 -- start start 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.598+0000 7f10ac800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c003a00 0x7f10a40c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10ac800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10ac800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10a414e520 0x7f10a41491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10ac800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a415bcf0 con 0x7f10a41e5970 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10ac800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4152350 con 0x7f108c003a00 2024-03-19T06:06:26.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10ac800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a415bfd0 con 0x7f10a414e520 2024-03-19T06:06:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.599+0000 7f10a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.600+0000 7f10a9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51662/0 (socket says 172.21.15.17:51662) 2024-03-19T06:06:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.600+0000 7f10a9400640 1 -- 172.21.15.17:0/3263902520 learned_addr learned my addr 172.21.15.17:0/3263902520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.600+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c003a00 0x7f10a40c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.601+0000 7f10aa800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10a414e520 0x7f10a41491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.604+0000 7f10a9400640 1 -- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10a414e520 msgr2=0x7f10a41491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.604+0000 7f10a9400640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10a414e520 0x7f10a41491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.604+0000 7f10a9400640 1 -- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c003a00 msgr2=0x7f10a40c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:26.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.604+0000 7f10a9400640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c003a00 0x7f10a40c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:26.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.604+0000 7f10a9400640 1 -- 172.21.15.17:0/3263902520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40cb5a0 con 0x7f10a41e5970 2024-03-19T06:06:26.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.608+0000 7f10a9400640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f109400f8e0 tx=0x7f109400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.614+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400dc70 con 0x7f10a41e5970 2024-03-19T06:06:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.614+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109400de10 con 0x7f10a41e5970 2024-03-19T06:06:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.614+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094013680 con 0x7f10a41e5970 2024-03-19T06:06:26.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.614+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a41efc10 con 0x7f10a41e5970 2024-03-19T06:06:26.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.615+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41f01d0 con 0x7f10a41e5970 2024-03-19T06:06:26.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.616+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a4069be0 con 0x7f10a41e5970 2024-03-19T06:06:26.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.649+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1094013820 con 0x7f10a41e5970 2024-03-19T06:06:26.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.652+0000 7f109e000640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 0x7f108806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:26.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.652+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 0x7f108806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:26.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.653+0000 7f10a9e00640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 0x7f108806e110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f1098009030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:26.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.965+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1094014e70 con 0x7f10a41e5970 2024-03-19T06:06:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:26.966+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f1094017030 con 0x7f10a41e5970 2024-03-19T06:06:27.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.190+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a40c6400 con 0x7f10a41e5970 2024-03-19T06:06:27.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.261+0000 7f109e000640 1 -- 172.21.15.17:0/3263902520 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12872 (secure 0 0 0) 0x7f1094059bf0 con 0x7f10a41e5970 2024-03-19T06:06:27.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:27.252 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:10.875407+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:27.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 msgr2=0x7f108806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 0x7f108806e110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1098034000 tx=0x7f1098009030 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 msgr2=0x7f10a414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f109400f8e0 tx=0x7f109400fda0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 shutdown_connections 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f10a414e520 0x7f10a41491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a41e5970 0x7f10a414dfe0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f108806bc50 0x7f108806e110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 --2- 172.21.15.17:0/3263902520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c003a00 0x7f10a40c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 >> 172.21.15.17:0/3263902520 conn(0x7f10a40c8910 msgr2=0x7f10a4150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.264+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 shutdown_connections 2024-03-19T06:06:27.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.265+0000 7f10ac800640 1 -- 172.21.15.17:0/3263902520 wait complete. 2024-03-19T06:06:27.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-19T06:06:27.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:06:27.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.502+0000 7f297c200640 1 Processor -- start 2024-03-19T06:06:27.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.502+0000 7f297c200640 1 -- start start 2024-03-19T06:06:27.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.504+0000 7f297c200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f29741541d0 0x7f29740ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.504+0000 7f297c200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f29740cb8d0 0x7f29740cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.504+0000 7f297c200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f297415d3b0 con 0x7f29740cb2d0 2024-03-19T06:06:27.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.504+0000 7f297c200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297415a0d0 con 0x7f29740cb8d0 2024-03-19T06:06:27.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.504+0000 7f297c200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297415a3b0 con 0x7f29741541d0 2024-03-19T06:06:27.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.506+0000 7f297a200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f29740cb2d0 0x7f297415d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:44320/0 (socket says 172.21.15.17:44320) 2024-03-19T06:06:27.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.506+0000 7f297a200640 1 -- 172.21.15.17:0/878974564 learned_addr learned my addr 172.21.15.17:0/878974564 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:27.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.507+0000 7f2979800640 1 --2- 172.21.15.17:0/878974564 >> v2:172.21.15.153:3300/0 conn(0x7f29741541d0 0x7f29740ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:27.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.516+0000 7f2979800640 1 -- 172.21.15.17:0/878974564 >> v2:172.21.15.17:3300/0 conn(0x7f29740cb8d0 msgr2=0x7f29740cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:27.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.516+0000 7f2979800640 1 --2- 172.21.15.17:0/878974564 >> v2:172.21.15.17:3300/0 conn(0x7f29740cb8d0 0x7f29740cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.516+0000 7f2979800640 1 -- 172.21.15.17:0/878974564 >> v1:172.21.15.153:6789/0 conn(0x7f29740cb2d0 legacy=0x7f297415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.516+0000 7f2979800640 1 -- 172.21.15.17:0/878974564 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297415a690 con 0x7f29741541d0 2024-03-19T06:06:27.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.529+0000 7f2979800640 1 --2- 172.21.15.17:0/878974564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29741541d0 0x7f29740ca2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f297408cb70 tx=0x7f296802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db85b5906092deef server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:27.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.540+0000 7f2973e00640 1 -- 172.21.15.17:0/878974564 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968034070 con 0x7f29741541d0 2024-03-19T06:06:27.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.540+0000 7f2973e00640 1 -- 172.21.15.17:0/878974564 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2968030610 con 0x7f29741541d0 2024-03-19T06:06:27.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.540+0000 7f2973e00640 1 -- 172.21.15.17:0/878974564 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29680309e0 con 0x7f29741541d0 2024-03-19T06:06:27.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 -- 172.21.15.17:0/878974564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29741541d0 msgr2=0x7f29740ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 --2- 172.21.15.17:0/878974564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29741541d0 0x7f29740ca2a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f297408cb70 tx=0x7f296802b960 comp rx=0 tx=0).stop 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 -- 172.21.15.17:0/878974564 shutdown_connections 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 --2- 172.21.15.17:0/878974564 >> v2:172.21.15.17:3300/0 conn(0x7f29740cb8d0 0x7f29740cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 --2- 172.21.15.17:0/878974564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29741541d0 0x7f29740ca2a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 -- 172.21.15.17:0/878974564 >> 172.21.15.17:0/878974564 conn(0x7f297406baf0 msgr2=0x7f297406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.541+0000 7f297c200640 1 -- 172.21.15.17:0/878974564 shutdown_connections 2024-03-19T06:06:27.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.542+0000 7f297c200640 1 -- 172.21.15.17:0/878974564 wait complete. 2024-03-19T06:06:27.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.545+0000 7f297c200640 1 Processor -- start 2024-03-19T06:06:27.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.545+0000 7f297c200640 1 -- start start 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.546+0000 7f297c200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cb2d0 0x7f29741571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.547+0000 7f297c200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.547+0000 7f297c200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29741541d0 0x7f29741557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.547+0000 7f297c200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297415ac50 con 0x7f29740cb2d0 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.547+0000 7f297c200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974159da0 con 0x7f29740cb8d0 2024-03-19T06:06:27.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.547+0000 7f297c200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29740ca7e0 con 0x7f29741541d0 2024-03-19T06:06:27.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.548+0000 7f2978e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.549+0000 7f297a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29741541d0 0x7f29741557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.549+0000 7f2978e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:34152/0 (socket says 172.21.15.17:34152) 2024-03-19T06:06:27.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.549+0000 7f2978e00640 1 -- 172.21.15.17:0/640764079 learned_addr learned my addr 172.21.15.17:0/640764079 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.559+0000 7f2978e00640 1 -- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29741541d0 msgr2=0x7f29741557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.559+0000 7f2978e00640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29741541d0 0x7f29741557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.559+0000 7f2978e00640 1 -- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cb2d0 msgr2=0x7f29741571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.559+0000 7f2978e00640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cb2d0 0x7f29741571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:27.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.559+0000 7f2978e00640 1 -- 172.21.15.17:0/640764079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2974156950 con 0x7f29740cb8d0 2024-03-19T06:06:27.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.566+0000 7f2978e00640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296000b500 tx=0x7f296000b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.577+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960014070 con 0x7f29740cb8d0 2024-03-19T06:06:27.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.577+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960010870 con 0x7f29740cb8d0 2024-03-19T06:06:27.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.577+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960010c60 con 0x7f29740cb8d0 2024-03-19T06:06:27.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.577+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2974156c30 con 0x7f29740cb8d0 2024-03-19T06:06:27.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.578+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29740c7170 con 0x7f29740cb8d0 2024-03-19T06:06:27.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.580+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29740b5920 con 0x7f29740cb8d0 2024-03-19T06:06:27.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.638+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2960017070 con 0x7f29740cb8d0 2024-03-19T06:06:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.640+0000 7f2971600640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 0x7f295406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.641+0000 7f2979800640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 0x7f295406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.643+0000 7f2979800640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 0x7f295406e0e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2968036000 tx=0x7f2968030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:27.650+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f296005f3c0 con 0x7f29740cb8d0 2024-03-19T06:06:28.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.027+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f29740b5920 con 0x7f29740cb8d0 2024-03-19T06:06:28.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.255+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29740b4750 con 0x7f29740cb8d0 2024-03-19T06:06:28.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.303+0000 7f2971600640 1 -- 172.21.15.17:0/640764079 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29740b4750 con 0x7f29740cb8d0 2024-03-19T06:06:28.295 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.307+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 msgr2=0x7f295406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.307+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 0x7f295406e0e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2968036000 tx=0x7f2968030000 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.307+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 msgr2=0x7f29741effe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.307+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296000b500 tx=0x7f296000b9c0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 shutdown_connections 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f29741541d0 0x7f29741557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f295406bc20 0x7f295406e0e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29740cb8d0 0x7f29741effe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 --2- 172.21.15.17:0/640764079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cb2d0 0x7f29741571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 >> 172.21.15.17:0/640764079 conn(0x7f297406baf0 msgr2=0x7f29740b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 shutdown_connections 2024-03-19T06:06:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.308+0000 7f297c200640 1 -- 172.21.15.17:0/640764079 wait complete. 2024-03-19T06:06:28.318 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-19T06:06:28.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.539+0000 7f7455000640 1 Processor -- start 2024-03-19T06:06:28.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.540+0000 7f7455000640 1 -- start start 2024-03-19T06:06:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.541+0000 7f7455000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74500c6c60 0x7f74500c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.541+0000 7f7455000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500c9440 con 0x7f745015aeb0 2024-03-19T06:06:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.541+0000 7f7455000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500c9700 con 0x7f7450151a90 2024-03-19T06:06:28.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.541+0000 7f7455000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74500c8ce0 con 0x7f74500c6c60 2024-03-19T06:06:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.547+0000 7f744fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f745015aeb0 0x7f745015b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56758/0 (socket says 172.21.15.17:56758) 2024-03-19T06:06:28.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.547+0000 7f744fe00640 1 -- 172.21.15.17:0/725880560 learned_addr learned my addr 172.21.15.17:0/725880560 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:28.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.547+0000 7f7447e00640 1 --2- 172.21.15.17:0/725880560 >> v2:172.21.15.17:3300/0 conn(0x7f74500c6c60 0x7f74500c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:28.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.655+0000 7f7447e00640 1 -- 172.21.15.17:0/725880560 >> v1:172.21.15.153:6789/0 conn(0x7f7450151a90 legacy=0x7f74500c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.655+0000 7f7447e00640 1 -- 172.21.15.17:0/725880560 >> v1:172.21.15.17:6789/0 conn(0x7f745015aeb0 legacy=0x7f745015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.655+0000 7f7447e00640 1 -- 172.21.15.17:0/725880560 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500c99e0 con 0x7f74500c6c60 2024-03-19T06:06:28.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.664+0000 7f7447e00640 1 --2- 172.21.15.17:0/725880560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74500c6c60 0x7f74500c87a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74380097a0 tx=0x7f743802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209aa1d80d84f52e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:28.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.688+0000 7f744ea00640 1 -- 172.21.15.17:0/725880560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438034070 con 0x7f74500c6c60 2024-03-19T06:06:28.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.688+0000 7f744ea00640 1 -- 172.21.15.17:0/725880560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438030610 con 0x7f74500c6c60 2024-03-19T06:06:28.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.688+0000 7f744ea00640 1 -- 172.21.15.17:0/725880560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380309e0 con 0x7f74500c6c60 2024-03-19T06:06:28.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.689+0000 7f7455000640 1 -- 172.21.15.17:0/725880560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74500c6c60 msgr2=0x7f74500c87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.689+0000 7f7455000640 1 --2- 172.21.15.17:0/725880560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74500c6c60 0x7f74500c87a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74380097a0 tx=0x7f743802b960 comp rx=0 tx=0).stop 2024-03-19T06:06:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.690+0000 7f7455000640 1 -- 172.21.15.17:0/725880560 shutdown_connections 2024-03-19T06:06:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.690+0000 7f7455000640 1 --2- 172.21.15.17:0/725880560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74500c6c60 0x7f74500c87a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.690+0000 7f7455000640 1 -- 172.21.15.17:0/725880560 >> 172.21.15.17:0/725880560 conn(0x7f7450071b60 msgr2=0x7f7450071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.690+0000 7f7455000640 1 -- 172.21.15.17:0/725880560 shutdown_connections 2024-03-19T06:06:28.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.690+0000 7f7455000640 1 -- 172.21.15.17:0/725880560 wait complete. 2024-03-19T06:06:28.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.694+0000 7f7455000640 1 Processor -- start 2024-03-19T06:06:28.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.695+0000 7f7455000640 1 -- start start 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74500c6c60 0x7f745014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745015aeb0 0x7f7450158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450151e70 con 0x7f7450151a90 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745006b3f0 con 0x7f745015aeb0 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.697+0000 7f7455000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7450151ff0 con 0x7f74500c6c60 2024-03-19T06:06:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.698+0000 7f7447e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.698+0000 7f7447e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51688/0 (socket says 172.21.15.17:51688) 2024-03-19T06:06:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.698+0000 7f7447e00640 1 -- 172.21.15.17:0/315884503 learned_addr learned my addr 172.21.15.17:0/315884503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.698+0000 7f744fe00640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745015aeb0 0x7f7450158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.699+0000 7f744f400640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74500c6c60 0x7f745014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:28.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.703+0000 7f7447e00640 1 -- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74500c6c60 msgr2=0x7f745014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.703+0000 7f7447e00640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74500c6c60 0x7f745014f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.703+0000 7f7447e00640 1 -- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745015aeb0 msgr2=0x7f7450158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:28.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.703+0000 7f7447e00640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745015aeb0 0x7f7450158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:28.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.703+0000 7f7447e00640 1 -- 172.21.15.17:0/315884503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7450140000 con 0x7f7450151a90 2024-03-19T06:06:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.707+0000 7f7447e00640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7438009890 tx=0x7f74380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:28.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.717+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438034040 con 0x7f7450151a90 2024-03-19T06:06:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.717+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438039a10 con 0x7f7450151a90 2024-03-19T06:06:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.717+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438039de0 con 0x7f7450151a90 2024-03-19T06:06:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.717+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74501e18c0 con 0x7f7450151a90 2024-03-19T06:06:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.718+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74501e26a0 con 0x7f7450151a90 2024-03-19T06:06:28.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:28.719+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745004f050 con 0x7f7450151a90 2024-03-19T06:06:29.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.053+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7438037070 con 0x7f7450151a90 2024-03-19T06:06:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.055+0000 7f7447400640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 0x7f742c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.056+0000 7f744f400640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 0x7f742c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:29.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.057+0000 7f744f400640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 0x7f742c06e0e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7440000f60 tx=0x7f7440009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:29.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.096+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7438081cc0 con 0x7f7450151a90 2024-03-19T06:06:29.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.097+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f743807b9a0 con 0x7f7450151a90 2024-03-19T06:06:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.320+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f745006ad70 con 0x7f7450151a90 2024-03-19T06:06:29.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.341+0000 7f7447400640 1 -- 172.21.15.17:0/315884503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f743807fa40 con 0x7f7450151a90 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-19T06:06:29.333 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-19T06:06:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 msgr2=0x7f742c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 0x7f742c06e0e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7440000f60 tx=0x7f7440009040 comp rx=0 tx=0).stop 2024-03-19T06:06:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 msgr2=0x7f745013e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7438009890 tx=0x7f74380046c0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 shutdown_connections 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f742c06bc20 0x7f742c06e0e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f745015aeb0 0x7f7450158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7450151a90 0x7f745013e100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 --2- 172.21.15.17:0/315884503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74500c6c60 0x7f745014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 >> 172.21.15.17:0/315884503 conn(0x7f7450071b60 msgr2=0x7f745006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 shutdown_connections 2024-03-19T06:06:29.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.345+0000 7f7455000640 1 -- 172.21.15.17:0/315884503 wait complete. 2024-03-19T06:06:29.354 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-19T06:06:29.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-19T06:06:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.583+0000 7ff565200640 1 Processor -- start 2024-03-19T06:06:29.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.584+0000 7ff565200640 1 -- start start 2024-03-19T06:06:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.585+0000 7ff565200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff5600ca3d0 0x7ff5600c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.585+0000 7ff565200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5600cbe00 con 0x7ff5600c49c0 2024-03-19T06:06:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.585+0000 7ff565200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56015e250 con 0x7ff560154210 2024-03-19T06:06:29.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.585+0000 7ff565200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5600cbb20 con 0x7ff5600ca3d0 2024-03-19T06:06:29.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.587+0000 7ff55de00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff560154210 0x7ff56015a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:44334/0 (socket says 172.21.15.17:44334) 2024-03-19T06:06:29.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.587+0000 7ff55de00640 1 -- 172.21.15.17:0/1850130554 learned_addr learned my addr 172.21.15.17:0/1850130554 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.680+0000 7ff555400640 1 --2- 172.21.15.17:0/1850130554 >> v2:172.21.15.17:3300/0 conn(0x7ff5600ca3d0 0x7ff5600c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.693+0000 7ff555400640 1 -- 172.21.15.17:0/1850130554 >> v1:172.21.15.153:6789/0 conn(0x7ff560154210 legacy=0x7ff56015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.693+0000 7ff555400640 1 -- 172.21.15.17:0/1850130554 >> v1:172.21.15.17:6789/0 conn(0x7ff5600c49c0 legacy=0x7ff5600cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.693+0000 7ff555400640 1 -- 172.21.15.17:0/1850130554 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56015d490 con 0x7ff5600ca3d0 2024-03-19T06:06:29.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.705+0000 7ff555400640 1 --2- 172.21.15.17:0/1850130554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600ca3d0 0x7ff5600c4480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5480097a0 tx=0x7ff54802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3dc48c316f12af server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:29.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.717+0000 7ff55d400640 1 -- 172.21.15.17:0/1850130554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802f810 con 0x7ff5600ca3d0 2024-03-19T06:06:29.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.717+0000 7ff55d400640 1 -- 172.21.15.17:0/1850130554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54802f9b0 con 0x7ff5600ca3d0 2024-03-19T06:06:29.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.717+0000 7ff55d400640 1 -- 172.21.15.17:0/1850130554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54802fd80 con 0x7ff5600ca3d0 2024-03-19T06:06:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.718+0000 7ff565200640 1 -- 172.21.15.17:0/1850130554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600ca3d0 msgr2=0x7ff5600c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.718+0000 7ff565200640 1 --2- 172.21.15.17:0/1850130554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600ca3d0 0x7ff5600c4480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5480097a0 tx=0x7ff54802b9f0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.719+0000 7ff565200640 1 -- 172.21.15.17:0/1850130554 shutdown_connections 2024-03-19T06:06:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.719+0000 7ff565200640 1 --2- 172.21.15.17:0/1850130554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600ca3d0 0x7ff5600c4480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.719+0000 7ff565200640 1 -- 172.21.15.17:0/1850130554 >> 172.21.15.17:0/1850130554 conn(0x7ff560072750 msgr2=0x7ff560072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.719+0000 7ff565200640 1 -- 172.21.15.17:0/1850130554 shutdown_connections 2024-03-19T06:06:29.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.719+0000 7ff565200640 1 -- 172.21.15.17:0/1850130554 wait complete. 2024-03-19T06:06:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.724+0000 7ff565200640 1 Processor -- start 2024-03-19T06:06:29.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.724+0000 7ff565200640 1 -- start start 2024-03-19T06:06:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5600ca3d0 0x7ff56014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:29.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff560154210 0x7ff560150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56015dd30 con 0x7ff5600c49c0 2024-03-19T06:06:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56015da50 con 0x7ff560154210 2024-03-19T06:06:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.726+0000 7ff565200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5600cb7b0 con 0x7ff5600ca3d0 2024-03-19T06:06:29.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.728+0000 7ff55de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.728+0000 7ff55de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51712/0 (socket says 172.21.15.17:51712) 2024-03-19T06:06:29.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.728+0000 7ff55de00640 1 -- 172.21.15.17:0/2295247849 learned_addr learned my addr 172.21.15.17:0/2295247849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.737+0000 7ff55de00640 1 -- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5600ca3d0 msgr2=0x7ff56014a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.737+0000 7ff55de00640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5600ca3d0 0x7ff56014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.737+0000 7ff55de00640 1 -- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff560154210 msgr2=0x7ff560150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.737+0000 7ff55de00640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff560154210 0x7ff560150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.737+0000 7ff55de00640 1 -- 172.21.15.17:0/2295247849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600c68e0 con 0x7ff5600c49c0 2024-03-19T06:06:29.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.743+0000 7ff55de00640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c480 tx=0x7ff55000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:29.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.752+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff550017070 con 0x7ff5600c49c0 2024-03-19T06:06:29.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.752+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff550005ce0 con 0x7ff5600c49c0 2024-03-19T06:06:29.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.752+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500072f0 con 0x7ff5600c49c0 2024-03-19T06:06:29.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.752+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5601f3b50 con 0x7ff5600c49c0 2024-03-19T06:06:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.753+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5600c9310 con 0x7ff5600c49c0 2024-03-19T06:06:29.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:29.754+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560069be0 con 0x7ff5600c49c0 2024-03-19T06:06:30.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.101+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff55001a070 con 0x7ff5600c49c0 2024-03-19T06:06:30.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.103+0000 7ff556a00640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 0x7ff53c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:30.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.104+0000 7ff555400640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 0x7ff53c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.107+0000 7ff555400640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 0x7ff53c06e0e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff548036000 tx=0x7ff548039040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:30.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.142+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff55005ea50 con 0x7ff5600c49c0 2024-03-19T06:06:30.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.142+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7ff550058730 con 0x7ff5600c49c0 2024-03-19T06:06:30.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:30.372+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff5600cd460 con 0x7ff5600c49c0 2024-03-19T06:06:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.491+0000 7ff556a00640 1 -- 172.21.15.17:0/2295247849 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff55005c7d0 con 0x7ff5600c49c0 2024-03-19T06:06:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 msgr2=0x7ff53c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 0x7ff53c06e0e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff548036000 tx=0x7ff548039040 comp rx=0 tx=0).stop 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 msgr2=0x7ff560159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c480 tx=0x7ff55000c940 comp rx=0 tx=0).stop 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 shutdown_connections 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff53c06bc20 0x7ff53c06e0e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff560154210 0x7ff560150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff5600ca3d0 0x7ff56014a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 --2- 172.21.15.17:0/2295247849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5600c49c0 0x7ff560159c00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.494+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 >> 172.21.15.17:0/2295247849 conn(0x7ff560072750 msgr2=0x7ff5600ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.495+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 shutdown_connections 2024-03-19T06:06:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.495+0000 7ff565200640 1 -- 172.21.15.17:0/2295247849 wait complete. 2024-03-19T06:06:31.508 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-19T06:06:31.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.738+0000 7f4d72e00640 1 Processor -- start 2024-03-19T06:06:31.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.738+0000 7f4d72e00640 1 -- start start 2024-03-19T06:06:31.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.740+0000 7f4d72e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 0x7f4d6c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:31.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.740+0000 7f4d72e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d6c15dc60 0x7f4d6c0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:31.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.741+0000 7f4d72e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c15a200 con 0x7f4d6c15b080 2024-03-19T06:06:31.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.741+0000 7f4d72e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c15e0f0 con 0x7f4d6c15dc60 2024-03-19T06:06:31.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.741+0000 7f4d72e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0caac0 con 0x7f4d6c0c9410 2024-03-19T06:06:31.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.743+0000 7f4d71a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 0x7f4d6c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.743+0000 7f4d71000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4d6c15b080 0x7f4d6c0ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:36480/0 (socket says 172.21.15.17:36480) 2024-03-19T06:06:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.743+0000 7f4d71000640 1 -- 172.21.15.17:0/76473910 learned_addr learned my addr 172.21.15.17:0/76473910 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:31.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.743+0000 7f4d72400640 1 --2- 172.21.15.17:0/76473910 >> v2:172.21.15.153:3300/0 conn(0x7f4d6c15dc60 0x7f4d6c0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:31.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.750+0000 7f4d71a00640 1 -- 172.21.15.17:0/76473910 >> v2:172.21.15.153:3300/0 conn(0x7f4d6c15dc60 msgr2=0x7f4d6c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:31.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.750+0000 7f4d71a00640 1 --2- 172.21.15.17:0/76473910 >> v2:172.21.15.153:3300/0 conn(0x7f4d6c15dc60 0x7f4d6c0caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.750+0000 7f4d71a00640 1 -- 172.21.15.17:0/76473910 >> v1:172.21.15.153:6789/0 conn(0x7f4d6c15b080 legacy=0x7f4d6c0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.750+0000 7f4d71a00640 1 -- 172.21.15.17:0/76473910 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c15a4c0 con 0x7f4d6c0c9410 2024-03-19T06:06:31.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.756+0000 7f4d71a00640 1 --2- 172.21.15.17:0/76473910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 0x7f4d6c159c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1d88c949891399 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:31.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d6be00640 1 -- 172.21.15.17:0/76473910 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c035020 con 0x7f4d6c0c9410 2024-03-19T06:06:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d6be00640 1 -- 172.21.15.17:0/76473910 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c031810 con 0x7f4d6c0c9410 2024-03-19T06:06:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d6be00640 1 -- 172.21.15.17:0/76473910 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c031be0 con 0x7f4d6c0c9410 2024-03-19T06:06:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 -- 172.21.15.17:0/76473910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 msgr2=0x7f4d6c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 --2- 172.21.15.17:0/76473910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 0x7f4d6c159c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c02b8b0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 -- 172.21.15.17:0/76473910 shutdown_connections 2024-03-19T06:06:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 --2- 172.21.15.17:0/76473910 >> v2:172.21.15.153:3300/0 conn(0x7f4d6c15dc60 0x7f4d6c0caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 --2- 172.21.15.17:0/76473910 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c0c9410 0x7f4d6c159c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.769+0000 7f4d72e00640 1 -- 172.21.15.17:0/76473910 >> 172.21.15.17:0/76473910 conn(0x7f4d6c072360 msgr2=0x7f4d6c072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.770+0000 7f4d72e00640 1 -- 172.21.15.17:0/76473910 shutdown_connections 2024-03-19T06:06:31.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.770+0000 7f4d72e00640 1 -- 172.21.15.17:0/76473910 wait complete. 2024-03-19T06:06:31.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.771+0000 7f4d72e00640 1 Processor -- start 2024-03-19T06:06:31.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.772+0000 7f4d72e00640 1 -- start start 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6c0c9410 0x7f4d6c0c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c15dc60 0x7f4d6c151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c15d180 con 0x7f4d6c15b080 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c15aa80 con 0x7f4d6c0c9410 2024-03-19T06:06:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.773+0000 7f4d72e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c15d460 con 0x7f4d6c15dc60 2024-03-19T06:06:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.774+0000 7f4d71000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.774+0000 7f4d71000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33568/0 (socket says 172.21.15.17:33568) 2024-03-19T06:06:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.774+0000 7f4d71000640 1 -- 172.21.15.17:0/3970720364 learned_addr learned my addr 172.21.15.17:0/3970720364 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.774+0000 7f4d71a00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6c0c9410 0x7f4d6c0c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.775+0000 7f4d72400640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c15dc60 0x7f4d6c151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.778+0000 7f4d71000640 1 -- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c15dc60 msgr2=0x7f4d6c151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.778+0000 7f4d71000640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c15dc60 0x7f4d6c151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.778+0000 7f4d71000640 1 -- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6c0c9410 msgr2=0x7f4d6c0c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.778+0000 7f4d71000640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6c0c9410 0x7f4d6c0c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.778+0000 7f4d71000640 1 -- 172.21.15.17:0/3970720364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0c29d0 con 0x7f4d6c15b080 2024-03-19T06:06:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.781+0000 7f4d71000640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000cb10 tx=0x7f4d6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:31.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.786+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60017070 con 0x7f4d6c15b080 2024-03-19T06:06:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.787+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000ac70 con 0x7f4d6c15b080 2024-03-19T06:06:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.787+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60012620 con 0x7f4d6c15b080 2024-03-19T06:06:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.787+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c14fdc0 con 0x7f4d6c15b080 2024-03-19T06:06:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.787+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c1e45a0 con 0x7f4d6c15b080 2024-03-19T06:06:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:31.788+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c04f050 con 0x7f4d6c15b080 2024-03-19T06:06:32.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.122+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4d6001a070 con 0x7f4d6c15b080 2024-03-19T06:06:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.126+0000 7f4d69600640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 0x7f4d5006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:32.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.127+0000 7f4d71a00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 0x7f4d5006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:32.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.129+0000 7f4d71a00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 0x7f4d5006e0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c03d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:32.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.174+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4d600571a0 con 0x7f4d6c15b080 2024-03-19T06:06:32.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.175+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4d60021020 con 0x7f4d6c15b080 2024-03-19T06:06:32.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:32.408+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4d6c15d6a0 con 0x7f4d6c15b080 2024-03-19T06:06:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.035+0000 7f4d69600640 1 -- 172.21.15.17:0/3970720364 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4d60059100 con 0x7f4d6c15b080 2024-03-19T06:06:33.026 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 msgr2=0x7f4d5006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 0x7f4d5006e0e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0097a0 tx=0x7f4d5c03d040 comp rx=0 tx=0).stop 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 msgr2=0x7f4d6c1e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000cb10 tx=0x7f4d6000a060 comp rx=0 tx=0).stop 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 shutdown_connections 2024-03-19T06:06:33.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4d6c15dc60 0x7f4d6c151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d6c15b080 0x7f4d6c1e5080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4d5006bc20 0x7f4d5006e0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 --2- 172.21.15.17:0/3970720364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d6c0c9410 0x7f4d6c0c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 >> 172.21.15.17:0/3970720364 conn(0x7f4d6c072360 msgr2=0x7f4d6c15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 shutdown_connections 2024-03-19T06:06:33.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.038+0000 7f4d72e00640 1 -- 172.21.15.17:0/3970720364 wait complete. 2024-03-19T06:06:33.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-19T06:06:33.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.269+0000 7fefc9a00640 1 Processor -- start 2024-03-19T06:06:33.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.269+0000 7fefc9a00640 1 -- start start 2024-03-19T06:06:33.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.270+0000 7fefc9a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.270+0000 7fefc9a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefc40c1e60 0x7fefc406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.270+0000 7fefc9a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc40c27c0 con 0x7fefc4151f70 2024-03-19T06:06:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.270+0000 7fefc9a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc4157f30 con 0x7fefc40c1e60 2024-03-19T06:06:33.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.270+0000 7fefc9a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc4152350 con 0x7fefc415b1d0 2024-03-19T06:06:33.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.272+0000 7fefc2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.273+0000 7fefc2000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:37488/0 (socket says 172.21.15.17:37488) 2024-03-19T06:06:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.273+0000 7fefc2000640 1 -- 172.21.15.17:0/3615318016 learned_addr learned my addr 172.21.15.17:0/3615318016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:33.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.273+0000 7fefc3400640 1 --2- 172.21.15.17:0/3615318016 >> v2:172.21.15.153:3300/0 conn(0x7fefc40c1e60 0x7fefc406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:33.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.279+0000 7fefc2000640 1 -- 172.21.15.17:0/3615318016 >> v2:172.21.15.153:3300/0 conn(0x7fefc40c1e60 msgr2=0x7fefc406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:33.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.279+0000 7fefc2000640 1 --2- 172.21.15.17:0/3615318016 >> v2:172.21.15.153:3300/0 conn(0x7fefc40c1e60 0x7fefc406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.279+0000 7fefc2000640 1 -- 172.21.15.17:0/3615318016 >> v1:172.21.15.153:6789/0 conn(0x7fefc4151f70 legacy=0x7fefc41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.280+0000 7fefc2000640 1 -- 172.21.15.17:0/3615318016 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc4157be0 con 0x7fefc415b1d0 2024-03-19T06:06:33.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.286+0000 7fefc2000640 1 --2- 172.21.15.17:0/3615318016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009870 tx=0x7fefb002ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a124a30f540a81d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.294+0000 7fefc1600640 1 -- 172.21.15.17:0/3615318016 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb002f830 con 0x7fefc415b1d0 2024-03-19T06:06:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.294+0000 7fefc1600640 1 -- 172.21.15.17:0/3615318016 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb002f9d0 con 0x7fefc415b1d0 2024-03-19T06:06:33.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.294+0000 7fefc1600640 1 -- 172.21.15.17:0/3615318016 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb002fda0 con 0x7fefc415b1d0 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 -- 172.21.15.17:0/3615318016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 msgr2=0x7fefc40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 --2- 172.21.15.17:0/3615318016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009870 tx=0x7fefb002ba10 comp rx=0 tx=0).stop 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 -- 172.21.15.17:0/3615318016 shutdown_connections 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 --2- 172.21.15.17:0/3615318016 >> v2:172.21.15.153:3300/0 conn(0x7fefc40c1e60 0x7fefc406e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 --2- 172.21.15.17:0/3615318016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc415b1d0 0x7fefc40c7760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 -- 172.21.15.17:0/3615318016 >> 172.21.15.17:0/3615318016 conn(0x7fefc40c8910 msgr2=0x7fefc40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 -- 172.21.15.17:0/3615318016 shutdown_connections 2024-03-19T06:06:33.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.295+0000 7fefc9a00640 1 -- 172.21.15.17:0/3615318016 wait complete. 2024-03-19T06:06:33.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.297+0000 7fefc9a00640 1 Processor -- start 2024-03-19T06:06:33.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.297+0000 7fefc9a00640 1 -- start start 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefc4151f70 0x7fefc414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc415b1d0 0x7fefc4154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc415bcf0 con 0x7fefc4151f70 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc415ba10 con 0x7fefc415b1d0 2024-03-19T06:06:33.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.298+0000 7fefc9a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc415bfd0 con 0x7fefc40c1e60 2024-03-19T06:06:33.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.300+0000 7fefc2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:33.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.302+0000 7fefc2a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:37504/0 (socket says 172.21.15.17:37504) 2024-03-19T06:06:33.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.302+0000 7fefc2a00640 1 -- 172.21.15.17:0/2780490970 learned_addr learned my addr 172.21.15.17:0/2780490970 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:33.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.304+0000 7fefc3400640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc415b1d0 0x7fefc4154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.314+0000 7fefc2a00640 1 -- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc415b1d0 msgr2=0x7fefc4154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.314+0000 7fefc2a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc415b1d0 0x7fefc4154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.314+0000 7fefc2a00640 1 -- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefc4151f70 msgr2=0x7fefc414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.314+0000 7fefc2a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefc4151f70 0x7fefc414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:33.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.314+0000 7fefc2a00640 1 -- 172.21.15.17:0/2780490970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc414f510 con 0x7fefc40c1e60 2024-03-19T06:06:33.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.322+0000 7fefc2a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c450 tx=0x7fefb400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.334+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40052d0 con 0x7fefc40c1e60 2024-03-19T06:06:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.334+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4005470 con 0x7fefc40c1e60 2024-03-19T06:06:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.334+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb4012870 con 0x7fefc40c1e60 2024-03-19T06:06:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.334+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc4154440 con 0x7fefc40c1e60 2024-03-19T06:06:33.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.334+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc41e0fc0 con 0x7fefc40c1e60 2024-03-19T06:06:33.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.336+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc41517a0 con 0x7fefc40c1e60 2024-03-19T06:06:33.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.391+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fefb4012a10 con 0x7fefc40c1e60 2024-03-19T06:06:33.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.393+0000 7fefbaa00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 0x7fefa406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:33.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.394+0000 7fefc2000640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 0x7fefa406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:33.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.394+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fefb4057520 con 0x7fefc40c1e60 2024-03-19T06:06:33.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.396+0000 7fefc2000640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 0x7fefa406e110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefb0036000 tx=0x7fefb0039040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:33.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:33.765+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fefc41517a0 con 0x7fefc40c1e60 2024-03-19T06:06:34.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:34.041+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fefc40c7200 con 0x7fefc40c1e60 2024-03-19T06:06:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.567+0000 7fefbaa00640 1 -- 172.21.15.17:0/2780490970 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v5) v1 ==== 172+0+0 (secure 0 0 0) 0x7fefc414f510 con 0x7fefc40c1e60 2024-03-19T06:06:36.559 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-03-19T06:06:36.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 msgr2=0x7fefa406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 0x7fefa406e110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fefb0036000 tx=0x7fefb0039040 comp rx=0 tx=0).stop 2024-03-19T06:06:36.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 msgr2=0x7fefc4152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fefb400c450 tx=0x7fefb400c910 comp rx=0 tx=0).stop 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 shutdown_connections 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fefa406bc50 0x7fefa406e110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefc415b1d0 0x7fefc4154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fefc4151f70 0x7fefc414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 --2- 172.21.15.17:0/2780490970 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fefc40c1e60 0x7fefc4152510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 >> 172.21.15.17:0/2780490970 conn(0x7fefc40c8910 msgr2=0x7fefc4155860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.571+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 shutdown_connections 2024-03-19T06:06:36.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.572+0000 7fefc9a00640 1 -- 172.21.15.17:0/2780490970 wait complete. 2024-03-19T06:06:36.583 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-19T06:06:36.661 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-19T06:06:36.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.877+0000 7fb7cbe00640 1 Processor -- start 2024-03-19T06:06:36.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.877+0000 7fb7cbe00640 1 -- start start 2024-03-19T06:06:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.878+0000 7fb7cbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7cc0c6550 0x7fb7cc165630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.878+0000 7fb7cbe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0c7160 con 0x7fb7cc0bf970 2024-03-19T06:06:36.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.878+0000 7fb7cbe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0c7400 con 0x7fb7cc15a9e0 2024-03-19T06:06:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.878+0000 7fb7cbe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc0bfd50 con 0x7fb7cc0c6550 2024-03-19T06:06:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.879+0000 7fb7cb400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb7cc0c6550 0x7fb7cc165630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:36.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.880+0000 7fb7caa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb7cc0bf970 0x7fb7cc15d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56232/0 (socket says 172.21.15.17:56232) 2024-03-19T06:06:36.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.880+0000 7fb7caa00640 1 -- 172.21.15.17:0/3049293115 learned_addr learned my addr 172.21.15.17:0/3049293115 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.886+0000 7fb7cb400640 1 -- 172.21.15.17:0/3049293115 >> v1:172.21.15.153:6789/0 conn(0x7fb7cc15a9e0 legacy=0x7fb7cc0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.886+0000 7fb7cb400640 1 -- 172.21.15.17:0/3049293115 >> v1:172.21.15.17:6789/0 conn(0x7fb7cc0bf970 legacy=0x7fb7cc15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.886+0000 7fb7cb400640 1 -- 172.21.15.17:0/3049293115 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc159f00 con 0x7fb7cc0c6550 2024-03-19T06:06:36.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.889+0000 7fb7cb400640 1 --2- 172.21.15.17:0/3049293115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0c6550 0x7fb7cc165630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009d90 tx=0x7fb7c402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a165134b624728 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:36.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.899+0000 7fb7ca000640 1 -- 172.21.15.17:0/3049293115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4039070 con 0x7fb7cc0c6550 2024-03-19T06:06:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.900+0000 7fb7ca000640 1 -- 172.21.15.17:0/3049293115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c402cc60 con 0x7fb7cc0c6550 2024-03-19T06:06:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.900+0000 7fb7ca000640 1 -- 172.21.15.17:0/3049293115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4034660 con 0x7fb7cc0c6550 2024-03-19T06:06:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.900+0000 7fb7cbe00640 1 -- 172.21.15.17:0/3049293115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0c6550 msgr2=0x7fb7cc165630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.900+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/3049293115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0c6550 0x7fb7cc165630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009d90 tx=0x7fb7c402beb0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.901+0000 7fb7cbe00640 1 -- 172.21.15.17:0/3049293115 shutdown_connections 2024-03-19T06:06:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.901+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/3049293115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0c6550 0x7fb7cc165630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.901+0000 7fb7cbe00640 1 -- 172.21.15.17:0/3049293115 >> 172.21.15.17:0/3049293115 conn(0x7fb7cc06db20 msgr2=0x7fb7cc06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.901+0000 7fb7cbe00640 1 -- 172.21.15.17:0/3049293115 shutdown_connections 2024-03-19T06:06:36.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.901+0000 7fb7cbe00640 1 -- 172.21.15.17:0/3049293115 wait complete. 2024-03-19T06:06:36.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.903+0000 7fb7cbe00640 1 Processor -- start 2024-03-19T06:06:36.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.903+0000 7fb7cbe00640 1 -- start start 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7cc0c6550 0x7fb7cc1e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7cc15a9e0 0x7fb7cc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc15a4c0 con 0x7fb7cc0bf970 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0c76e0 con 0x7fb7cc15a9e0 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.904+0000 7fb7cbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0c8210 con 0x7fb7cc0c6550 2024-03-19T06:06:36.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.905+0000 7fb7caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.905+0000 7fb7caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33588/0 (socket says 172.21.15.17:33588) 2024-03-19T06:06:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.905+0000 7fb7caa00640 1 -- 172.21.15.17:0/2872118191 learned_addr learned my addr 172.21.15.17:0/2872118191 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.905+0000 7fb7c3e00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7cc0c6550 0x7fb7cc1e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.909+0000 7fb7caa00640 1 -- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7cc0c6550 msgr2=0x7fb7cc1e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.909+0000 7fb7caa00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7cc0c6550 0x7fb7cc1e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.909+0000 7fb7caa00640 1 -- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7cc15a9e0 msgr2=0x7fb7cc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.909+0000 7fb7caa00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7cc15a9e0 0x7fb7cc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.909+0000 7fb7caa00640 1 -- 172.21.15.17:0/2872118191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc1e5fe0 con 0x7fb7cc0bf970 2024-03-19T06:06:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.912+0000 7fb7caa00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c430 tx=0x7fb7bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.916+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc017070 con 0x7fb7cc0bf970 2024-03-19T06:06:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.916+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc005ce0 con 0x7fb7cc0bf970 2024-03-19T06:06:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.916+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc007310 con 0x7fb7cc0bf970 2024-03-19T06:06:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.916+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0ca160 con 0x7fb7cc0bf970 2024-03-19T06:06:36.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.916+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc0ca700 con 0x7fb7cc0bf970 2024-03-19T06:06:36.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.917+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc0ca900 con 0x7fb7cc0bf970 2024-03-19T06:06:36.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.940+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb7bc01a070 con 0x7fb7cc0bf970 2024-03-19T06:06:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.941+0000 7fb7c2a00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 0x7fb7a806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:36.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.942+0000 7fb7c3e00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 0x7fb7a806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:36.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:36.942+0000 7fb7c3e00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 0x7fb7a806e110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc147ee0 tx=0x7fb7b4009060 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.267+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7bc056780 con 0x7fb7cc0bf970 2024-03-19T06:06:37.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.268+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb7bc021020 con 0x7fb7cc0bf970 2024-03-19T06:06:37.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.498+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb7cc04f050 con 0x7fb7cc0bf970 2024-03-19T06:06:37.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.883+0000 7fb7c2a00640 1 -- 172.21.15.17:0/2872118191 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7fb7bc0586e0 con 0x7fb7cc0bf970 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 msgr2=0x7fb7a806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 0x7fb7a806e110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc147ee0 tx=0x7fb7b4009060 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 msgr2=0x7fb7cc1f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00c430 tx=0x7fb7bc00c8f0 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 shutdown_connections 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb7a806bc50 0x7fb7a806e110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7cc15a9e0 0x7fb7cc06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb7cc0c6550 0x7fb7cc1e5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 --2- 172.21.15.17:0/2872118191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7cc0bf970 0x7fb7cc1f0850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.886+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 >> 172.21.15.17:0/2872118191 conn(0x7fb7cc06db20 msgr2=0x7fb7cc157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.887+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 shutdown_connections 2024-03-19T06:06:37.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:37.887+0000 7fb7cbe00640 1 -- 172.21.15.17:0/2872118191 wait complete. 2024-03-19T06:06:37.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-19T06:06:38.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.128+0000 7fe55a200640 1 Processor -- start 2024-03-19T06:06:38.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.129+0000 7fe55a200640 1 -- start start 2024-03-19T06:06:38.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.130+0000 7fe55a200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5540cb960 0x7fe5540c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.130+0000 7fe55a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe554159be0 0x7fe5540c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.130+0000 7fe55a200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55415a120 con 0x7fe5541540b0 2024-03-19T06:06:38.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.130+0000 7fe55a200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540c70a0 con 0x7fe5540cb960 2024-03-19T06:06:38.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.130+0000 7fe55a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55415a400 con 0x7fe554159be0 2024-03-19T06:06:38.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.141+0000 7fe558e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe5541540b0 0x7fe5540ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:36494/0 (socket says 172.21.15.17:36494) 2024-03-19T06:06:38.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.141+0000 7fe558e00640 1 -- 172.21.15.17:0/359754331 learned_addr learned my addr 172.21.15.17:0/359754331 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:38.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.142+0000 7fe553e00640 1 --2- 172.21.15.17:0/359754331 >> v2:172.21.15.153:3300/0 conn(0x7fe5540cb960 0x7fe5540c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.152+0000 7fe553e00640 1 -- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe554159be0 msgr2=0x7fe5540c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.152+0000 7fe553e00640 1 --2- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe554159be0 0x7fe5540c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.152+0000 7fe553e00640 1 -- 172.21.15.17:0/359754331 >> v1:172.21.15.153:6789/0 conn(0x7fe5541540b0 legacy=0x7fe5540ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:38.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.152+0000 7fe553e00640 1 -- 172.21.15.17:0/359754331 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55415a6e0 con 0x7fe5540cb960 2024-03-19T06:06:38.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.173+0000 7fe553e00640 1 --2- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5540c7810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5540c7220 tx=0x7fe54002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1911a4ffc6890d5e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.195+0000 7fe553400640 1 -- 172.21.15.17:0/359754331 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540035020 con 0x7fe5540cb960 2024-03-19T06:06:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.195+0000 7fe553400640 1 -- 172.21.15.17:0/359754331 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540031800 con 0x7fe5540cb960 2024-03-19T06:06:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.195+0000 7fe553400640 1 -- 172.21.15.17:0/359754331 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540031bd0 con 0x7fe5540cb960 2024-03-19T06:06:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.196+0000 7fe55a200640 1 -- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 msgr2=0x7fe5540c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.196+0000 7fe55a200640 1 --2- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5540c7810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5540c7220 tx=0x7fe54002b8a0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 -- 172.21.15.17:0/359754331 shutdown_connections 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 --2- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe554159be0 0x7fe5540c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 --2- 172.21.15.17:0/359754331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5540c7810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 -- 172.21.15.17:0/359754331 >> 172.21.15.17:0/359754331 conn(0x7fe5540cf370 msgr2=0x7fe5540cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 -- 172.21.15.17:0/359754331 shutdown_connections 2024-03-19T06:06:38.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.197+0000 7fe55a200640 1 -- 172.21.15.17:0/359754331 wait complete. 2024-03-19T06:06:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.200+0000 7fe55a200640 1 Processor -- start 2024-03-19T06:06:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.200+0000 7fe55a200640 1 -- start start 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5541f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5541540b0 0x7fe5541e5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 0x7fe55414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540c6800 con 0x7fe554159be0 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540c72f0 con 0x7fe5540cb960 2024-03-19T06:06:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.202+0000 7fe55a200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540c6980 con 0x7fe5541540b0 2024-03-19T06:06:38.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.204+0000 7fe558e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5541f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.204+0000 7fe559800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 0x7fe55414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.204+0000 7fe558e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5541f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:58644/0 (socket says 172.21.15.17:58644) 2024-03-19T06:06:38.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.204+0000 7fe558e00640 1 -- 172.21.15.17:0/1602582736 learned_addr learned my addr 172.21.15.17:0/1602582736 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.212+0000 7fe559800640 1 -- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5541540b0 msgr2=0x7fe5541e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.212+0000 7fe559800640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5541540b0 0x7fe5541e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.213+0000 7fe559800640 1 -- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 msgr2=0x7fe5541f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:38.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.213+0000 7fe559800640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5541f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:38.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.213+0000 7fe559800640 1 -- 172.21.15.17:0/1602582736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5541ef930 con 0x7fe554159be0 2024-03-19T06:06:38.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.219+0000 7fe559800640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 0x7fe55414e350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00be20 tx=0x7fe54c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.226+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c019070 con 0x7fe554159be0 2024-03-19T06:06:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.226+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c014440 con 0x7fe554159be0 2024-03-19T06:06:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.226+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c014830 con 0x7fe554159be0 2024-03-19T06:06:38.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.226+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe554155230 con 0x7fe554159be0 2024-03-19T06:06:38.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.227+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5541efeb0 con 0x7fe554159be0 2024-03-19T06:06:38.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.228+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5540c9bf0 con 0x7fe554159be0 2024-03-19T06:06:38.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.255+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe54c01c070 con 0x7fe554159be0 2024-03-19T06:06:38.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.256+0000 7fe550c00640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 0x7fe53406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:38.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.256+0000 7fe558e00640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 0x7fe53406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:38.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.257+0000 7fe558e00640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 0x7fe53406e110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe548005880 tx=0x7fe548009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.583+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fe54c057330 con 0x7fe554159be0 2024-03-19T06:06:38.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.584+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fe5540c9bf0 con 0x7fe554159be0 2024-03-19T06:06:38.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:38.811+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe55404f050 con 0x7fe554159be0 2024-03-19T06:06:41.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.025+0000 7fe550c00640 1 -- 172.21.15.17:0/1602582736 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7fe54c023020 con 0x7fe554159be0 2024-03-19T06:06:41.016 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' created 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 msgr2=0x7fe53406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 0x7fe53406e110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe548005880 tx=0x7fe548009040 comp rx=0 tx=0).stop 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 msgr2=0x7fe55414e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 0x7fe55414e350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00be20 tx=0x7fe54c00bf10 comp rx=0 tx=0).stop 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 shutdown_connections 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe554159be0 0x7fe55414e350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe5541540b0 0x7fe5541e5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe53406bc50 0x7fe53406e110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 --2- 172.21.15.17:0/1602582736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5540cb960 0x7fe5541f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 >> 172.21.15.17:0/1602582736 conn(0x7fe5540cf370 msgr2=0x7fe554150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 shutdown_connections 2024-03-19T06:06:41.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.029+0000 7fe55a200640 1 -- 172.21.15.17:0/1602582736 wait complete. 2024-03-19T06:06:41.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-19T06:06:41.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.258+0000 7fc538e00640 1 Processor -- start 2024-03-19T06:06:41.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.258+0000 7fc538e00640 1 -- start start 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc534154210 0x7fc53415a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5340ca3d0 0x7fc5340c4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53415ad50 con 0x7fc534154210 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5340cbe00 con 0x7fc5340ca3d0 2024-03-19T06:06:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.260+0000 7fc538e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415e250 con 0x7fc5340c49c0 2024-03-19T06:06:41.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.267+0000 7fc532800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:41.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.268+0000 7fc532800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:34080/0 (socket says 172.21.15.17:34080) 2024-03-19T06:06:41.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.268+0000 7fc532800640 1 -- 172.21.15.17:0/3057612994 learned_addr learned my addr 172.21.15.17:0/3057612994 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.274+0000 7fc532800640 1 -- 172.21.15.17:0/3057612994 >> v2:172.21.15.153:3300/0 conn(0x7fc5340ca3d0 msgr2=0x7fc5340c4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.274+0000 7fc532800640 1 --2- 172.21.15.17:0/3057612994 >> v2:172.21.15.153:3300/0 conn(0x7fc5340ca3d0 0x7fc5340c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.274+0000 7fc532800640 1 -- 172.21.15.17:0/3057612994 >> v2:172.21.15.17:3300/0 conn(0x7fc534154210 msgr2=0x7fc53415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.274+0000 7fc532800640 1 --2- 172.21.15.17:0/3057612994 >> v2:172.21.15.17:3300/0 conn(0x7fc534154210 0x7fc53415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.274+0000 7fc532800640 1 -- 172.21.15.17:0/3057612994 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5340cbb20 con 0x7fc5340c49c0 2024-03-19T06:06:41.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.279+0000 7fc532800640 1 --2- 172.21.15.17:0/3057612994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cf570 tx=0x7fc52c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9022d521812a7f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:41.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.292+0000 7fc530a00640 1 -- 172.21.15.17:0/3057612994 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c02cb00 con 0x7fc5340c49c0 2024-03-19T06:06:41.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.292+0000 7fc530a00640 1 -- 172.21.15.17:0/3057612994 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c02cca0 con 0x7fc5340c49c0 2024-03-19T06:06:41.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.292+0000 7fc530a00640 1 -- 172.21.15.17:0/3057612994 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c034610 con 0x7fc5340c49c0 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.293+0000 7fc538e00640 1 -- 172.21.15.17:0/3057612994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 msgr2=0x7fc5340cc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.293+0000 7fc538e00640 1 --2- 172.21.15.17:0/3057612994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc5340cf570 tx=0x7fc52c02bf60 comp rx=0 tx=0).stop 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 -- 172.21.15.17:0/3057612994 shutdown_connections 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 --2- 172.21.15.17:0/3057612994 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340c49c0 0x7fc5340cc5b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 --2- 172.21.15.17:0/3057612994 >> v2:172.21.15.153:3300/0 conn(0x7fc5340ca3d0 0x7fc5340c4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 --2- 172.21.15.17:0/3057612994 >> v2:172.21.15.17:3300/0 conn(0x7fc534154210 0x7fc53415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 -- 172.21.15.17:0/3057612994 >> 172.21.15.17:0/3057612994 conn(0x7fc534072750 msgr2=0x7fc534072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 -- 172.21.15.17:0/3057612994 shutdown_connections 2024-03-19T06:06:41.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.294+0000 7fc538e00640 1 -- 172.21.15.17:0/3057612994 wait complete. 2024-03-19T06:06:41.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.296+0000 7fc538e00640 1 Processor -- start 2024-03-19T06:06:41.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.296+0000 7fc538e00640 1 -- start start 2024-03-19T06:06:41.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.297+0000 7fc538e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.298+0000 7fc538e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340ca3d0 0x7fc5341e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.298+0000 7fc538e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc534154210 0x7fc5341e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.298+0000 7fc538e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415da50 con 0x7fc534154210 2024-03-19T06:06:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.298+0000 7fc538e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415d770 con 0x7fc5340c49c0 2024-03-19T06:06:41.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.298+0000 7fc538e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53415dd30 con 0x7fc5340ca3d0 2024-03-19T06:06:41.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.299+0000 7fc531e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:41.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.300+0000 7fc531400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340ca3d0 0x7fc5341e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:41.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.300+0000 7fc531e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46740/0 (socket says 172.21.15.17:46740) 2024-03-19T06:06:41.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.300+0000 7fc531e00640 1 -- 172.21.15.17:0/4081541111 learned_addr learned my addr 172.21.15.17:0/4081541111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.304+0000 7fc532800640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc534154210 0x7fc5341e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:41.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.310+0000 7fc531e00640 1 -- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340ca3d0 msgr2=0x7fc5341e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.310+0000 7fc531e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340ca3d0 0x7fc5341e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.310+0000 7fc531e00640 1 -- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc534154210 msgr2=0x7fc5341e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.310+0000 7fc531e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc534154210 0x7fc5341e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.310+0000 7fc531e00640 1 -- 172.21.15.17:0/4081541111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53415ab60 con 0x7fc5340c49c0 2024-03-19T06:06:41.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.320+0000 7fc531e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b500 tx=0x7fc52400b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.348+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524015020 con 0x7fc5340c49c0 2024-03-19T06:06:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.349+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524011890 con 0x7fc5340c49c0 2024-03-19T06:06:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.349+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011c80 con 0x7fc5340c49c0 2024-03-19T06:06:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.349+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5340b4a00 con 0x7fc5340c49c0 2024-03-19T06:06:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.349+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5341f0340 con 0x7fc5340c49c0 2024-03-19T06:06:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.351+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc534069be0 con 0x7fc5340c49c0 2024-03-19T06:06:41.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.413+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc524018020 con 0x7fc5340c49c0 2024-03-19T06:06:41.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.415+0000 7fc52a000640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 0x7fc51406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:41.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.416+0000 7fc531400640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 0x7fc51406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:41.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.417+0000 7fc531400640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 0x7fc51406e0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc5340ccd10 tx=0x7fc520009110 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:41.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.421+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fc524025e10 con 0x7fc5340c49c0 2024-03-19T06:06:41.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.757+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc52401f020 con 0x7fc5340c49c0 2024-03-19T06:06:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:41.979+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc5340caf10 con 0x7fc5340c49c0 2024-03-19T06:06:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.195+0000 7fc52a000640 1 -- 172.21.15.17:0/4081541111 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc52400d040 con 0x7fc5340c49c0 2024-03-19T06:06:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:set pool 4 allow_ec_overwrites to true 2024-03-19T06:06:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 msgr2=0x7fc51406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 0x7fc51406e0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc5340ccd10 tx=0x7fc520009110 comp rx=0 tx=0).stop 2024-03-19T06:06:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 msgr2=0x7fc5341e3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:43.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc52400b500 tx=0x7fc52400b900 comp rx=0 tx=0).stop 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 shutdown_connections 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc534154210 0x7fc5341e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5340ca3d0 0x7fc5341e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc51406bc20 0x7fc51406e0e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 --2- 172.21.15.17:0/4081541111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5340c49c0 0x7fc5341e3110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.199+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 >> 172.21.15.17:0/4081541111 conn(0x7fc534072750 msgr2=0x7fc534152540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.200+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 shutdown_connections 2024-03-19T06:06:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.200+0000 7fc538e00640 1 -- 172.21.15.17:0/4081541111 wait complete. 2024-03-19T06:06:43.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-19T06:06:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.446+0000 7f4e6e000640 1 Processor -- start 2024-03-19T06:06:43.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.447+0000 7f4e6e000640 1 -- start start 2024-03-19T06:06:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.448+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6815aa80 0x7f4e680c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.448+0000 7f4e6e000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4e680c7250 0x7f4e6815d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.448+0000 7f4e6e000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6806b6e0 con 0x7f4e68157370 2024-03-19T06:06:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.448+0000 7f4e6e000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6806b9c0 con 0x7f4e680c7250 2024-03-19T06:06:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.448+0000 7f4e6e000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806bca0 con 0x7f4e6815aa80 2024-03-19T06:06:43.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.504+0000 7f4e6d600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4e680c7250 0x7f4e6815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.505+0000 7f4e6d600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4e680c7250 0x7f4e6815d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37192/0 (socket says 172.21.15.17:37192) 2024-03-19T06:06:43.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.505+0000 7f4e6d600640 1 -- 172.21.15.17:0/2868374122 learned_addr learned my addr 172.21.15.17:0/2868374122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:43.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.510+0000 7f4e67e00640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6815aa80 0x7f4e680c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.511+0000 7f4e6d600640 1 -- 172.21.15.17:0/2868374122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6815aa80 msgr2=0x7f4e680c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.511+0000 7f4e6d600640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6815aa80 0x7f4e680c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.511+0000 7f4e6d600640 1 -- 172.21.15.17:0/2868374122 >> v1:172.21.15.153:6789/0 conn(0x7f4e68157370 legacy=0x7f4e6806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:43.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.512+0000 7f4e6d600640 1 -- 172.21.15.17:0/2868374122 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6806bf80 con 0x7f4e680c7250 2024-03-19T06:06:43.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.517+0000 7f4e6d600640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e680c7250 0x7f4e6815d790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dc07d5cba0911c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.534+0000 7f4e67400640 1 -- 172.21.15.17:0/2868374122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002ca80 con 0x7f4e680c7250 2024-03-19T06:06:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.534+0000 7f4e67400640 1 -- 172.21.15.17:0/2868374122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6002cc20 con 0x7f4e680c7250 2024-03-19T06:06:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.534+0000 7f4e67400640 1 -- 172.21.15.17:0/2868374122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600343f0 con 0x7f4e680c7250 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.535+0000 7f4e6e000640 1 -- 172.21.15.17:0/2868374122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e680c7250 msgr2=0x7f4e6815d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.535+0000 7f4e6e000640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e680c7250 0x7f4e6815d790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6002bee0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 -- 172.21.15.17:0/2868374122 shutdown_connections 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e680c7250 0x7f4e6815d790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 --2- 172.21.15.17:0/2868374122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e6815aa80 0x7f4e680c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 -- 172.21.15.17:0/2868374122 >> 172.21.15.17:0/2868374122 conn(0x7f4e680cc260 msgr2=0x7f4e680cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 -- 172.21.15.17:0/2868374122 shutdown_connections 2024-03-19T06:06:43.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.536+0000 7f4e6e000640 1 -- 172.21.15.17:0/2868374122 wait complete. 2024-03-19T06:06:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.539+0000 7f4e6e000640 1 Processor -- start 2024-03-19T06:06:43.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.539+0000 7f4e6e000640 1 -- start start 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e680c7250 0x7f4e68155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e68157370 0x7f4e681594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681578d0 con 0x7f4e6815aa80 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68157750 con 0x7f4e680c7250 2024-03-19T06:06:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.541+0000 7f4e6e000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806fcb0 con 0x7f4e68157370 2024-03-19T06:06:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.542+0000 7f4e6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.542+0000 7f4e6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37200/0 (socket says 172.21.15.17:37200) 2024-03-19T06:06:43.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.542+0000 7f4e6d600640 1 -- 172.21.15.17:0/731150089 learned_addr learned my addr 172.21.15.17:0/731150089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.543+0000 7f4e6cc00640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e680c7250 0x7f4e68155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.543+0000 7f4e67e00640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e68157370 0x7f4e681594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.548+0000 7f4e6d600640 1 -- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e68157370 msgr2=0x7f4e681594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.548+0000 7f4e6d600640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e68157370 0x7f4e681594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.548+0000 7f4e6d600640 1 -- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e680c7250 msgr2=0x7f4e68155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.548+0000 7f4e6d600640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e680c7250 0x7f4e68155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:43.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.548+0000 7f4e6d600640 1 -- 172.21.15.17:0/731150089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680ca100 con 0x7f4e6815aa80 2024-03-19T06:06:43.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.552+0000 7f4e6d600640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.559+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60043020 con 0x7f4e6815aa80 2024-03-19T06:06:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.559+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6003e450 con 0x7f4e6815aa80 2024-03-19T06:06:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.559+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6003e820 con 0x7f4e6815aa80 2024-03-19T06:06:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.559+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e680cbe00 con 0x7f4e6815aa80 2024-03-19T06:06:43.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.559+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e680c5e40 con 0x7f4e6815aa80 2024-03-19T06:06:43.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.561+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6804f050 con 0x7f4e6815aa80 2024-03-19T06:06:43.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.593+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4e60046020 con 0x7f4e6815aa80 2024-03-19T06:06:43.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.595+0000 7f4e64c00640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 0x7f4e4806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:43.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.595+0000 7f4e6cc00640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 0x7f4e4806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:43.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.597+0000 7f4e6cc00640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 0x7f4e4806e0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0017f0 tx=0x7f4e5c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:43.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.597+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f4e60079f60 con 0x7f4e6815aa80 2024-03-19T06:06:43.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:43.928+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4e6004d030 con 0x7f4e6815aa80 2024-03-19T06:06:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:44.229+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f4e680c8030 con 0x7f4e6815aa80 2024-03-19T06:06:45.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.244+0000 7f4e64c00640 1 -- 172.21.15.17:0/731150089 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v8) v1 ==== 137+0+0 (secure 0 0 0) 0x7f4e6007bec0 con 0x7f4e6815aa80 2024-03-19T06:06:45.236 INFO:teuthology.orchestra.run.smithi017.stderr:added data pool 4 to fsmap 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.247+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 msgr2=0x7f4e4806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.247+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 0x7f4e4806e0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0017f0 tx=0x7f4e5c009040 comp rx=0 tx=0).stop 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.247+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 msgr2=0x7f4e68154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e60004a40 comp rx=0 tx=0).stop 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 shutdown_connections 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e6815aa80 0x7f4e68154660 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4e68157370 0x7f4e681594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4e4806bc20 0x7f4e4806e0e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 --2- 172.21.15.17:0/731150089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e680c7250 0x7f4e68155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 >> 172.21.15.17:0/731150089 conn(0x7f4e680cc260 msgr2=0x7f4e680cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 shutdown_connections 2024-03-19T06:06:45.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.248+0000 7f4e6e000640 1 -- 172.21.15.17:0/731150089 wait complete. 2024-03-19T06:06:45.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.501+0000 7fd38bc00640 1 Processor -- start 2024-03-19T06:06:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.501+0000 7fd38bc00640 1 -- start start 2024-03-19T06:06:45.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.503+0000 7fd38bc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd38415b1d0 0x7fd3840c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:45.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.503+0000 7fd38bc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840c27c0 con 0x7fd3840c1e60 2024-03-19T06:06:45.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.503+0000 7fd38bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd384157be0 con 0x7fd384151f70 2024-03-19T06:06:45.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.503+0000 7fd38bc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd384157f30 con 0x7fd38415b1d0 2024-03-19T06:06:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.536+0000 7fd389c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd3840c1e60 0x7fd38406e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36240/0 (socket says 172.21.15.17:36240) 2024-03-19T06:06:45.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.536+0000 7fd389c00640 1 -- 172.21.15.17:0/304102941 learned_addr learned my addr 172.21.15.17:0/304102941 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:45.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.536+0000 7fd383e00640 1 --2- 172.21.15.17:0/304102941 >> v2:172.21.15.17:3300/0 conn(0x7fd38415b1d0 0x7fd3840c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.550+0000 7fd383e00640 1 -- 172.21.15.17:0/304102941 >> v1:172.21.15.153:6789/0 conn(0x7fd384151f70 legacy=0x7fd3841583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.550+0000 7fd383e00640 1 -- 172.21.15.17:0/304102941 >> v1:172.21.15.17:6789/0 conn(0x7fd3840c1e60 legacy=0x7fd38406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.550+0000 7fd383e00640 1 -- 172.21.15.17:0/304102941 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38415b730 con 0x7fd38415b1d0 2024-03-19T06:06:45.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.557+0000 7fd383e00640 1 --2- 172.21.15.17:0/304102941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38415b1d0 0x7fd3840c7760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3841580b0 tx=0x7fd37002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29edfd9f67949cea server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:45.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.565+0000 7fd383400640 1 -- 172.21.15.17:0/304102941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370034070 con 0x7fd38415b1d0 2024-03-19T06:06:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.569+0000 7fd383400640 1 -- 172.21.15.17:0/304102941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd370030800 con 0x7fd38415b1d0 2024-03-19T06:06:45.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.569+0000 7fd383400640 1 -- 172.21.15.17:0/304102941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370030bd0 con 0x7fd38415b1d0 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 -- 172.21.15.17:0/304102941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38415b1d0 msgr2=0x7fd3840c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 --2- 172.21.15.17:0/304102941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38415b1d0 0x7fd3840c7760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3841580b0 tx=0x7fd37002b940 comp rx=0 tx=0).stop 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 -- 172.21.15.17:0/304102941 shutdown_connections 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 --2- 172.21.15.17:0/304102941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd38415b1d0 0x7fd3840c7760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 -- 172.21.15.17:0/304102941 >> 172.21.15.17:0/304102941 conn(0x7fd3840c8910 msgr2=0x7fd3840cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:45.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 -- 172.21.15.17:0/304102941 shutdown_connections 2024-03-19T06:06:45.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.571+0000 7fd38bc00640 1 -- 172.21.15.17:0/304102941 wait complete. 2024-03-19T06:06:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.574+0000 7fd38bc00640 1 Processor -- start 2024-03-19T06:06:45.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.574+0000 7fd38bc00640 1 -- start start 2024-03-19T06:06:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 0x7fd3840caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 0x7fd38414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd38415b1d0 0x7fd384158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38415bcf0 con 0x7fd3840c1e60 2024-03-19T06:06:45.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384152350 con 0x7fd384151f70 2024-03-19T06:06:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.576+0000 7fd38bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38415bfd0 con 0x7fd38415b1d0 2024-03-19T06:06:45.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.578+0000 7fd383e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 0x7fd38414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.579+0000 7fd383e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 0x7fd38414d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46760/0 (socket says 172.21.15.17:46760) 2024-03-19T06:06:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.579+0000 7fd383e00640 1 -- 172.21.15.17:0/388974245 learned_addr learned my addr 172.21.15.17:0/388974245 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:45.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.579+0000 7fd389200640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 0x7fd3840caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:45.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.579+0000 7fd389c00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd38415b1d0 0x7fd384158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:45.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.583+0000 7fd389200640 1 -- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd38415b1d0 msgr2=0x7fd384158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.583+0000 7fd389200640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd38415b1d0 0x7fd384158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.583+0000 7fd389200640 1 -- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 msgr2=0x7fd38414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:45.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.583+0000 7fd389200640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 0x7fd38414d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:45.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.583+0000 7fd389200640 1 -- 172.21.15.17:0/388974245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384071960 con 0x7fd3840c1e60 2024-03-19T06:06:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.588+0000 7fd389200640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 0x7fd3840caa30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c410 tx=0x7fd37800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:45.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.593+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378017070 con 0x7fd3840c1e60 2024-03-19T06:06:45.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.593+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780035f0 con 0x7fd3840c1e60 2024-03-19T06:06:45.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.593+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378003a20 con 0x7fd3840c1e60 2024-03-19T06:06:45.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.593+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384071c00 con 0x7fd3840c1e60 2024-03-19T06:06:45.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.593+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3840721c0 con 0x7fd3840c1e60 2024-03-19T06:06:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.595+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384069be0 con 0x7fd3840c1e60 2024-03-19T06:06:45.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.624+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd37801a070 con 0x7fd3840c1e60 2024-03-19T06:06:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.626+0000 7fd380c00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 0x7fd36406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.626+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd37808a430 con 0x7fd3840c1e60 2024-03-19T06:06:45.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.626+0000 7fd383e00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 0x7fd36406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:45.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.628+0000 7fd383e00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 0x7fd36406e110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd38415b1a0 tx=0x7fd37003b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:45.967+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fd378021020 con 0x7fd3840c1e60 2024-03-19T06:06:46.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.230+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3840c7200 con 0x7fd3840c1e60 2024-03-19T06:06:46.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.325+0000 7fd380c00640 1 -- 172.21.15.17:0/388974245 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6517 (secure 0 0 0) 0x7fd378058730 con 0x7fd3840c1e60 2024-03-19T06:06:46.316 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:46.316 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:06:44.258202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:06:46.317 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-03-19T06:06:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.328+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 msgr2=0x7fd36406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.328+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 0x7fd36406e110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd38415b1a0 tx=0x7fd37003b040 comp rx=0 tx=0).stop 2024-03-19T06:06:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.328+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 msgr2=0x7fd3840caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.328+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 0x7fd3840caa30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c410 tx=0x7fd37800c810 comp rx=0 tx=0).stop 2024-03-19T06:06:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 shutdown_connections 2024-03-19T06:06:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd38415b1d0 0x7fd384158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd36406bc50 0x7fd36406e110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd384151f70 0x7fd38414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 --2- 172.21.15.17:0/388974245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3840c1e60 0x7fd3840caa30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 >> 172.21.15.17:0/388974245 conn(0x7fd3840c8910 msgr2=0x7fd384155820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 shutdown_connections 2024-03-19T06:06:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.329+0000 7fd38bc00640 1 -- 172.21.15.17:0/388974245 wait complete. 2024-03-19T06:06:46.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:46.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.553+0000 7f3f0d400640 1 Processor -- start 2024-03-19T06:06:46.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.553+0000 7f3f0d400640 1 -- start start 2024-03-19T06:06:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.555+0000 7f3f0d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08150ea0 0x7f3f080c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.555+0000 7f3f0d400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f080c7b40 0x7f3f08072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.555+0000 7f3f0d400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0815a140 con 0x7f3f080728a0 2024-03-19T06:06:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.555+0000 7f3f0d400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0815afa0 con 0x7f3f080c7b40 2024-03-19T06:06:46.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.555+0000 7f3f0d400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815a420 con 0x7f3f08150ea0 2024-03-19T06:06:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.597+0000 7f3f07200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3f080728a0 0x7f3f08156e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:58790/0 (socket says 172.21.15.17:58790) 2024-03-19T06:06:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.598+0000 7f3f07200640 1 -- 172.21.15.17:0/640186841 learned_addr learned my addr 172.21.15.17:0/640186841 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.598+0000 7f3f05e00640 1 --2- 172.21.15.17:0/640186841 >> v2:172.21.15.153:3300/0 conn(0x7f3f080c7b40 0x7f3f08072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.605+0000 7f3f06800640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08150ea0 0x7f3f080c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.615+0000 7f3f05e00640 1 -- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08150ea0 msgr2=0x7f3f080c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.615+0000 7f3f05e00640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08150ea0 0x7f3f080c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.615+0000 7f3f05e00640 1 -- 172.21.15.17:0/640186841 >> v1:172.21.15.153:6789/0 conn(0x7f3f080728a0 legacy=0x7f3f08156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.615+0000 7f3f05e00640 1 -- 172.21.15.17:0/640186841 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0815a700 con 0x7f3f080c7b40 2024-03-19T06:06:46.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.630+0000 7f3f05e00640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08072360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe8bebd32e53f62 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.643+0000 7f3f05400640 1 -- 172.21.15.17:0/640186841 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4034070 con 0x7f3f080c7b40 2024-03-19T06:06:46.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.643+0000 7f3f05400640 1 -- 172.21.15.17:0/640186841 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4030610 con 0x7f3f080c7b40 2024-03-19T06:06:46.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.643+0000 7f3f05400640 1 -- 172.21.15.17:0/640186841 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40309e0 con 0x7f3f080c7b40 2024-03-19T06:06:46.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 -- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 msgr2=0x7f3f08072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08072360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b960 comp rx=0 tx=0).stop 2024-03-19T06:06:46.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 -- 172.21.15.17:0/640186841 shutdown_connections 2024-03-19T06:06:46.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08072360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 --2- 172.21.15.17:0/640186841 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08150ea0 0x7f3f080c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.644+0000 7f3f0d400640 1 -- 172.21.15.17:0/640186841 >> 172.21.15.17:0/640186841 conn(0x7f3f080673f0 msgr2=0x7f3f080cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:46.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.645+0000 7f3f0d400640 1 -- 172.21.15.17:0/640186841 shutdown_connections 2024-03-19T06:06:46.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.645+0000 7f3f0d400640 1 -- 172.21.15.17:0/640186841 wait complete. 2024-03-19T06:06:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.648+0000 7f3f0d400640 1 Processor -- start 2024-03-19T06:06:46.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.649+0000 7f3f0d400640 1 -- start start 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f080728a0 0x7f3f0814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 0x7f3f08146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080c78e0 con 0x7f3f08150ea0 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815acc0 con 0x7f3f080c7b40 2024-03-19T06:06:46.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.651+0000 7f3f0d400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080c8250 con 0x7f3f080728a0 2024-03-19T06:06:46.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.653+0000 7f3f05e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.653+0000 7f3f06800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f080728a0 0x7f3f0814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.654+0000 7f3f05e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46778/0 (socket says 172.21.15.17:46778) 2024-03-19T06:06:46.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.654+0000 7f3f05e00640 1 -- 172.21.15.17:0/3083692716 learned_addr learned my addr 172.21.15.17:0/3083692716 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:46.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.658+0000 7f3f07200640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 0x7f3f08146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.664+0000 7f3f05e00640 1 -- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f080728a0 msgr2=0x7f3f0814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.664+0000 7f3f05e00640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f080728a0 0x7f3f0814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.664+0000 7f3f05e00640 1 -- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 msgr2=0x7f3f08146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:46.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.664+0000 7f3f05e00640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 0x7f3f08146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:46.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.665+0000 7f3f05e00640 1 -- 172.21.15.17:0/3083692716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080c6670 con 0x7f3f080c7b40 2024-03-19T06:06:46.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.665+0000 7f3f07200640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 0x7f3f08146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:06:46.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.674+0000 7f3f05e00640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4000c00 tx=0x7f3ef40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.686+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4034040 con 0x7f3f080c7b40 2024-03-19T06:06:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.686+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4030410 con 0x7f3f080c7b40 2024-03-19T06:06:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.686+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4039c70 con 0x7f3f080c7b40 2024-03-19T06:06:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.686+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f08155860 con 0x7f3f080c7b40 2024-03-19T06:06:46.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.686+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f08155e20 con 0x7f3f080c7b40 2024-03-19T06:06:46.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:46.688+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f08067d60 con 0x7f3f080c7b40 2024-03-19T06:06:47.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.036+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3ef4037070 con 0x7f3f080c7b40 2024-03-19T06:06:47.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.038+0000 7f3efea00640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 0x7f3ee806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.038+0000 7f3f06800640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 0x7f3ee806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.040+0000 7f3f06800640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 0x7f3ee806e110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009aa0 tx=0x7f3ef8009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.042+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3ef40305c0 con 0x7f3f080c7b40 2024-03-19T06:06:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.114+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f3ef407bf30 con 0x7f3f080c7b40 2024-03-19T06:06:47.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.346+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f08074a20 con 0x7f3f080c7b40 2024-03-19T06:06:47.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.529+0000 7f3efea00640 1 -- 172.21.15.17:0/3083692716 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f3ef407b830 con 0x7f3f080c7b40 2024-03-19T06:06:47.521 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:47.521 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:44.249620+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 msgr2=0x7f3ee806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 0x7f3ee806e110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009aa0 tx=0x7f3ef8009190 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 msgr2=0x7f3f08148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4000c00 tx=0x7f3ef40046c0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 shutdown_connections 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f08150ea0 0x7f3f08146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee806bc50 0x7f3ee806e110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080c7b40 0x7f3f08148330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 --2- 172.21.15.17:0/3083692716 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f080728a0 0x7f3f0814fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 >> 172.21.15.17:0/3083692716 conn(0x7f3f080673f0 msgr2=0x7f3f080c85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 shutdown_connections 2024-03-19T06:06:47.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.533+0000 7f3f0d400640 1 -- 172.21.15.17:0/3083692716 wait complete. 2024-03-19T06:06:47.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:47.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.772+0000 7f999f000640 1 Processor -- start 2024-03-19T06:06:47.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.772+0000 7f999f000640 1 -- start start 2024-03-19T06:06:47.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.773+0000 7f999f000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9998150cc0 0x7f999815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.773+0000 7f999f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c6d40 0x7f999815aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.773+0000 7f999f000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99980c5cf0 con 0x7f99980c8970 2024-03-19T06:06:47.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.773+0000 7f999f000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99981510a0 con 0x7f9998150cc0 2024-03-19T06:06:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.773+0000 7f999f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99980c2eb0 con 0x7f99980c6d40 2024-03-19T06:06:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.774+0000 7f999dc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9998150cc0 0x7f999815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.774+0000 7f999dc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9998150cc0 0x7f999815a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37232/0 (socket says 172.21.15.17:37232) 2024-03-19T06:06:47.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.774+0000 7f999dc00640 1 -- 172.21.15.17:0/995121182 learned_addr learned my addr 172.21.15.17:0/995121182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:47.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.775+0000 7f999d200640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c6d40 0x7f999815aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.777+0000 7f999dc00640 1 -- 172.21.15.17:0/995121182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c6d40 msgr2=0x7f999815aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:47.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.777+0000 7f999dc00640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c6d40 0x7f999815aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.777+0000 7f999dc00640 1 -- 172.21.15.17:0/995121182 >> v1:172.21.15.153:6789/0 conn(0x7f99980c8970 legacy=0x7f99980c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.777+0000 7f999dc00640 1 -- 172.21.15.17:0/995121182 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980c28f0 con 0x7f9998150cc0 2024-03-19T06:06:47.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.780+0000 7f999dc00640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f999815a4e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f998c0098a0 tx=0x7f998c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a583e874583d388 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.785+0000 7f9997e00640 1 -- 172.21.15.17:0/995121182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c034070 con 0x7f9998150cc0 2024-03-19T06:06:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.785+0000 7f9997e00640 1 -- 172.21.15.17:0/995121182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c030840 con 0x7f9998150cc0 2024-03-19T06:06:47.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.785+0000 7f9997e00640 1 -- 172.21.15.17:0/995121182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c030c10 con 0x7f9998150cc0 2024-03-19T06:06:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 -- 172.21.15.17:0/995121182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 msgr2=0x7f999815a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f999815a4e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f998c0098a0 tx=0x7f998c02b980 comp rx=0 tx=0).stop 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 -- 172.21.15.17:0/995121182 shutdown_connections 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c6d40 0x7f999815aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 --2- 172.21.15.17:0/995121182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f999815a4e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.786+0000 7f999f000640 1 -- 172.21.15.17:0/995121182 >> 172.21.15.17:0/995121182 conn(0x7f999806e630 msgr2=0x7f999806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.787+0000 7f999f000640 1 -- 172.21.15.17:0/995121182 shutdown_connections 2024-03-19T06:06:47.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.787+0000 7f999f000640 1 -- 172.21.15.17:0/995121182 wait complete. 2024-03-19T06:06:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.789+0000 7f999f000640 1 Processor -- start 2024-03-19T06:06:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.789+0000 7f999f000640 1 -- start start 2024-03-19T06:06:47.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99980c6d40 0x7f99980cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c8970 0x7f9998158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9998072290 con 0x7f9998150cc0 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9998159fc0 con 0x7f99980c6d40 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.790+0000 7f999f000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9998072410 con 0x7f99980c8970 2024-03-19T06:06:47.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.791+0000 7f999e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.791+0000 7f999e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37242/0 (socket says 172.21.15.17:37242) 2024-03-19T06:06:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.791+0000 7f999e600640 1 -- 172.21.15.17:0/174797307 learned_addr learned my addr 172.21.15.17:0/174797307 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:47.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.792+0000 7f999d200640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c8970 0x7f9998158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.792+0000 7f999dc00640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99980c6d40 0x7f99980cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.795+0000 7f999e600640 1 -- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c8970 msgr2=0x7f9998158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.795+0000 7f999e600640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c8970 0x7f9998158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.795+0000 7f999e600640 1 -- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99980c6d40 msgr2=0x7f99980cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:47.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.795+0000 7f999e600640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99980c6d40 0x7f99980cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:47.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.795+0000 7f999e600640 1 -- 172.21.15.17:0/174797307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980c7d60 con 0x7f9998150cc0 2024-03-19T06:06:47.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.798+0000 7f999e600640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f999000c760 tx=0x7f999000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.803+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990003b70 con 0x7f9998150cc0 2024-03-19T06:06:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.803+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990003d10 con 0x7f9998150cc0 2024-03-19T06:06:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.803+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999000aa90 con 0x7f9998150cc0 2024-03-19T06:06:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.803+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99981ebe80 con 0x7f9998150cc0 2024-03-19T06:06:47.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.803+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99980c94d0 con 0x7f9998150cc0 2024-03-19T06:06:47.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.804+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99980686e0 con 0x7f9998150cc0 2024-03-19T06:06:47.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.828+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f999000ac30 con 0x7f9998150cc0 2024-03-19T06:06:47.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.829+0000 7f9995600640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 0x7f997806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:47.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.829+0000 7f999dc00640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 0x7f997806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:47.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.830+0000 7f999dc00640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 0x7f997806e110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f998c036000 tx=0x7f998c03b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:47.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:47.832+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9990057810 con 0x7f9998150cc0 2024-03-19T06:06:47.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:06:47.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:06:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.156+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f9990059770 con 0x7f9998150cc0 2024-03-19T06:06:48.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.371+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f999804f050 con 0x7f9998150cc0 2024-03-19T06:06:48.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.489+0000 7f9995600640 1 -- 172.21.15.17:0/174797307 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f999005d810 con 0x7f9998150cc0 2024-03-19T06:06:48.481 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:48.481 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:44.249620+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 msgr2=0x7f997806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 0x7f997806e110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f998c036000 tx=0x7f998c03b040 comp rx=0 tx=0).stop 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 msgr2=0x7f9998142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f999000c760 tx=0x7f999000cc20 comp rx=0 tx=0).stop 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 shutdown_connections 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9998150cc0 0x7f9998142b00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f99980c8970 0x7f9998158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f997806bc50 0x7f997806e110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 --2- 172.21.15.17:0/174797307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99980c6d40 0x7f99980cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 >> 172.21.15.17:0/174797307 conn(0x7f999806e630 msgr2=0x7f99980cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 shutdown_connections 2024-03-19T06:06:48.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.493+0000 7f999f000640 1 -- 172.21.15.17:0/174797307 wait complete. 2024-03-19T06:06:48.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:06:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.748+0000 7f0cafe00640 1 Processor -- start 2024-03-19T06:06:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.748+0000 7f0cafe00640 1 -- start start 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.750+0000 7f0cafe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0ca80c1e60 0x7f0ca80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.750+0000 7f0cafe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80c27c0 con 0x7f0ca815b1d0 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.750+0000 7f0cafe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca8157be0 con 0x7f0ca8151f70 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.750+0000 7f0cafe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca8157f30 con 0x7f0ca80c1e60 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.751+0000 7f0caca00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0ca815b1d0 0x7f0ca806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36250/0 (socket says 172.21.15.17:36250) 2024-03-19T06:06:48.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.751+0000 7f0caca00640 1 -- 172.21.15.17:0/2601668072 learned_addr learned my addr 172.21.15.17:0/2601668072 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:48.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.753+0000 7f0cade00640 1 --2- 172.21.15.17:0/2601668072 >> v2:172.21.15.153:3300/0 conn(0x7f0ca80c1e60 0x7f0ca80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.754+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192940721 0 0) 0x7f0ca80c27c0 con 0x7f0ca815b1d0 2024-03-19T06:06:48.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.755+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c90003520 con 0x7f0ca815b1d0 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132314386 0 0) 0x7f0c90003520 con 0x7f0ca815b1d0 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 >> v2:172.21.15.153:3300/0 conn(0x7f0ca80c1e60 msgr2=0x7f0ca80c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 --2- 172.21.15.17:0/2601668072 >> v2:172.21.15.153:3300/0 conn(0x7f0ca80c1e60 0x7f0ca80c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 >> v1:172.21.15.153:6789/0 conn(0x7f0ca8151f70 legacy=0x7f0ca81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca815b730 con 0x7f0ca815b1d0 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.760+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f0c94001690 con 0x7f0ca815b1d0 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 >> v1:172.21.15.17:6789/0 conn(0x7f0ca815b1d0 legacy=0x7f0ca806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 0x7f0c90003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 0x7f0c90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900051c0 0x7f0c9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8157f30 con 0x7f0c900039b0 2024-03-19T06:06:48.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9000c070 con 0x7f0c900051c0 2024-03-19T06:06:48.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.761+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9000c270 con 0x7f0c90004800 2024-03-19T06:06:48.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.763+0000 7f0cad400640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 0x7f0c90003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.763+0000 7f0caca00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 0x7f0c90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cad400640 1 -- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 msgr2=0x7f0c90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cad400640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c90004800 0x7f0c90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cad400640 1 -- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900051c0 msgr2=0x7f0c9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cad400640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c900051c0 0x7f0c9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cad400640 1 -- 172.21.15.17:0/2601668072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca815b730 con 0x7f0c900039b0 2024-03-19T06:06:48.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.766+0000 7f0cade00640 1 -- 172.21.15.17:0/2601668072 reap_dead start 2024-03-19T06:06:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.769+0000 7f0cad400640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 0x7f0c90003df0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c001750 tx=0x7f0c90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78b5fe0605d6873 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:48.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.775+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c001370 con 0x7f0c900039b0 2024-03-19T06:06:48.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.775+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0052d0 con 0x7f0c900039b0 2024-03-19T06:06:48.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.775+0000 7f0ca7e00640 1 -- 172.21.15.17:0/2601668072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c003830 con 0x7f0c900039b0 2024-03-19T06:06:48.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.776+0000 7f0cafe00640 1 -- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 msgr2=0x7f0c90003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.776+0000 7f0cafe00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 0x7f0c90003df0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c001750 tx=0x7f0c90005830 comp rx=0 tx=0).stop 2024-03-19T06:06:48.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.776+0000 7f0cafe00640 1 -- 172.21.15.17:0/2601668072 shutdown_connections 2024-03-19T06:06:48.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.776+0000 7f0cafe00640 1 --2- 172.21.15.17:0/2601668072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c900039b0 0x7f0c90003df0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.776+0000 7f0cafe00640 1 -- 172.21.15.17:0/2601668072 >> 172.21.15.17:0/2601668072 conn(0x7f0ca80c8910 msgr2=0x7f0ca80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:48.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.777+0000 7f0cafe00640 1 -- 172.21.15.17:0/2601668072 shutdown_connections 2024-03-19T06:06:48.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.777+0000 7f0cafe00640 1 -- 172.21.15.17:0/2601668072 wait complete. 2024-03-19T06:06:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.780+0000 7f0cafe00640 1 Processor -- start 2024-03-19T06:06:48.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.780+0000 7f0cafe00640 1 -- start start 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c900039b0 0x7f0ca80ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca81edd40 0x7f0ca81ee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815bcf0 con 0x7f0ca80caef0 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8152350 con 0x7f0ca81edd40 2024-03-19T06:06:48.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.782+0000 7f0cafe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca815bfd0 con 0x7f0c900039b0 2024-03-19T06:06:48.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.783+0000 7f0caca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.783+0000 7f0caca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37268/0 (socket says 172.21.15.17:37268) 2024-03-19T06:06:48.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.783+0000 7f0caca00640 1 -- 172.21.15.17:0/594595840 learned_addr learned my addr 172.21.15.17:0/594595840 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:48.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.784+0000 7f0cad400640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c900039b0 0x7f0ca80ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:48.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.788+0000 7f0caca00640 1 -- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c900039b0 msgr2=0x7f0ca80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.788+0000 7f0caca00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c900039b0 0x7f0ca80ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.788+0000 7f0caca00640 1 -- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca81edd40 msgr2=0x7f0ca81ee1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:48.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.788+0000 7f0caca00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca81edd40 0x7f0ca81ee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:48.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.788+0000 7f0caca00640 1 -- 172.21.15.17:0/594595840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca814d670 con 0x7f0ca80caef0 2024-03-19T06:06:48.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.791+0000 7f0caca00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007320 tx=0x7f0c940077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.796+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9401a070 con 0x7f0ca80caef0 2024-03-19T06:06:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.797+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9400f8a0 con 0x7f0ca80caef0 2024-03-19T06:06:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.797+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400fc90 con 0x7f0ca80caef0 2024-03-19T06:06:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.797+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80ca760 con 0x7f0ca80caef0 2024-03-19T06:06:48.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.797+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca81f1630 con 0x7f0ca80caef0 2024-03-19T06:06:48.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:48.799+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca8069be0 con 0x7f0ca80caef0 2024-03-19T06:06:49.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.113+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0c9401d070 con 0x7f0ca80caef0 2024-03-19T06:06:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.115+0000 7f0ca5600640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 0x7f0c8806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.116+0000 7f0cad400640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 0x7f0c8806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.117+0000 7f0cad400640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 0x7f0c8806e110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c033000 tx=0x7f0c9c009030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.202+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0c9400fe30 con 0x7f0ca80caef0 2024-03-19T06:06:49.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.204+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f0c94024020 con 0x7f0ca80caef0 2024-03-19T06:06:49.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.474+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca80c7ba0 con 0x7f0ca80caef0 2024-03-19T06:06:49.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.513+0000 7f0ca5600640 1 -- 172.21.15.17:0/594595840 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6517 (secure 0 0 0) 0x7f0c94058c70 con 0x7f0ca80caef0 2024-03-19T06:06:49.505 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:49.505 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:06:44.258202+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-19T06:06:49.505 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 8 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.516+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 msgr2=0x7f0c8806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.516+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 0x7f0c8806e110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c033000 tx=0x7f0c9c009030 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 msgr2=0x7f0ca8159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c94007320 tx=0x7f0c940077e0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 shutdown_connections 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0c8806bc50 0x7f0c8806e110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ca81edd40 0x7f0ca81ee1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ca80caef0 0x7f0ca8159010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 --2- 172.21.15.17:0/594595840 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0c900039b0 0x7f0ca80ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 >> 172.21.15.17:0/594595840 conn(0x7f0ca80c8910 msgr2=0x7f0ca81565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 shutdown_connections 2024-03-19T06:06:49.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.517+0000 7f0cafe00640 1 -- 172.21.15.17:0/594595840 wait complete. 2024-03-19T06:06:49.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.753+0000 7f47a4400640 1 Processor -- start 2024-03-19T06:06:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.753+0000 7f47a4400640 1 -- start start 2024-03-19T06:06:49.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.755+0000 7f47a4400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f479c0c1e60 0x7f479c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.755+0000 7f47a4400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0c27c0 con 0x7f479c151f70 2024-03-19T06:06:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.755+0000 7f47a4400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c157be0 con 0x7f479c15b1d0 2024-03-19T06:06:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.755+0000 7f47a4400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c157f30 con 0x7f479c0c1e60 2024-03-19T06:06:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.756+0000 7f47a1a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f479c151f70 0x7f479c1583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36258/0 (socket says 172.21.15.17:36258) 2024-03-19T06:06:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.756+0000 7f47a1a00640 1 -- 172.21.15.17:0/251882279 learned_addr learned my addr 172.21.15.17:0/251882279 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:49.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.759+0000 7f47a2400640 1 --2- 172.21.15.17:0/251882279 >> v2:172.21.15.17:3300/0 conn(0x7f479c0c1e60 0x7f479c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.760+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035540742 0 0) 0x7f479c0c27c0 con 0x7f479c151f70 2024-03-19T06:06:49.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.760+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4784003520 con 0x7f479c151f70 2024-03-19T06:06:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652901573 0 0) 0x7f4784003520 con 0x7f479c151f70 2024-03-19T06:06:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 >> v2:172.21.15.17:3300/0 conn(0x7f479c0c1e60 msgr2=0x7f479c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 --2- 172.21.15.17:0/251882279 >> v2:172.21.15.17:3300/0 conn(0x7f479c0c1e60 0x7f479c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 >> v1:172.21.15.153:6789/0 conn(0x7f479c15b1d0 legacy=0x7f479c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:49.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c15b730 con 0x7f479c151f70 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f4790001690 con 0x7f479c151f70 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 >> v1:172.21.15.17:6789/0 conn(0x7f479c151f70 legacy=0x7f479c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4784003a00 0x7f4784003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4784004800 0x7f4784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 0x7f478400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c157f30 con 0x7f47840051c0 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478400c0a0 con 0x7f4784004800 2024-03-19T06:06:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.765+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478400c2a0 con 0x7f4784003a00 2024-03-19T06:06:49.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.772+0000 7f47a2400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 0x7f478400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.775+0000 7f47a2400640 1 -- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4784003a00 msgr2=0x7f4784003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.775+0000 7f47a2400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4784003a00 0x7f4784003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.775+0000 7f47a2400640 1 -- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4784004800 msgr2=0x7f4784004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.775+0000 7f47a2400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4784004800 0x7f4784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.775+0000 7f47a2400640 1 -- 172.21.15.17:0/251882279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784003520 con 0x7f47840051c0 2024-03-19T06:06:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.776+0000 7f47a2400640 1 -- 172.21.15.17:0/251882279 reap_dead start 2024-03-19T06:06:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.778+0000 7f47a2400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 0x7f478400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4794009fc0 tx=0x7f4784005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114e5ec71b278ded server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.786+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794009c10 con 0x7f47840051c0 2024-03-19T06:06:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.786+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479402cca0 con 0x7f47840051c0 2024-03-19T06:06:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.786+0000 7f479be00640 1 -- 172.21.15.17:0/251882279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794003bd0 con 0x7f47840051c0 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 -- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 msgr2=0x7f478400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 0x7f478400b9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4794009fc0 tx=0x7f4784005830 comp rx=0 tx=0).stop 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 -- 172.21.15.17:0/251882279 shutdown_connections 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 --2- 172.21.15.17:0/251882279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47840051c0 0x7f478400b9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 -- 172.21.15.17:0/251882279 >> 172.21.15.17:0/251882279 conn(0x7f479c0c8910 msgr2=0x7f479c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 -- 172.21.15.17:0/251882279 shutdown_connections 2024-03-19T06:06:49.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.787+0000 7f47a4400640 1 -- 172.21.15.17:0/251882279 wait complete. 2024-03-19T06:06:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.790+0000 7f47a4400640 1 Processor -- start 2024-03-19T06:06:49.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.790+0000 7f47a4400640 1 -- start start 2024-03-19T06:06:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47840051c0 0x7f479c0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f479c1550b0 0x7f479c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15bcf0 con 0x7f479c155510 2024-03-19T06:06:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c152350 con 0x7f479c1550b0 2024-03-19T06:06:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.791+0000 7f47a4400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15bfd0 con 0x7f47840051c0 2024-03-19T06:06:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.792+0000 7f47a2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.792+0000 7f47a2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37292/0 (socket says 172.21.15.17:37292) 2024-03-19T06:06:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.792+0000 7f47a2400640 1 -- 172.21.15.17:0/1671958510 learned_addr learned my addr 172.21.15.17:0/1671958510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.796+0000 7f47a2400640 1 -- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47840051c0 msgr2=0x7f479c0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.796+0000 7f47a2400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47840051c0 0x7f479c0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.796+0000 7f47a2400640 1 -- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f479c1550b0 msgr2=0x7f479c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.796+0000 7f47a2400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f479c1550b0 0x7f479c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.796+0000 7f47a2400640 1 -- 172.21.15.17:0/1671958510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c152df0 con 0x7f479c155510 2024-03-19T06:06:49.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.800+0000 7f47a2400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f479400e200 tx=0x7f4794009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:49.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.807+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794003990 con 0x7f479c155510 2024-03-19T06:06:49.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.807+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794044070 con 0x7f479c155510 2024-03-19T06:06:49.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.807+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794003d90 con 0x7f479c155510 2024-03-19T06:06:49.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.807+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c1530d0 con 0x7f479c155510 2024-03-19T06:06:49.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.807+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c153690 con 0x7f479c155510 2024-03-19T06:06:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:49.809+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c069be0 con 0x7f479c155510 2024-03-19T06:06:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.212+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4794005d10 con 0x7f479c155510 2024-03-19T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.214+0000 7f4799600640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 0x7f477c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.215+0000 7f47a1a00640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 0x7f477c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:50.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.216+0000 7f47a1a00640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 0x7f477c06e110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f479c0c2690 tx=0x7f47900015d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:50.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.226+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f479407a1d0 con 0x7f479c155510 2024-03-19T06:06:50.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.229+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f479403d3c0 con 0x7f479c155510 2024-03-19T06:06:50.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.448+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c0c7200 con 0x7f479c155510 2024-03-19T06:06:50.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.552+0000 7f4799600640 1 -- 172.21.15.17:0/1671958510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f479407c830 con 0x7f479c155510 2024-03-19T06:06:50.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:50.544 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:44.249620+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:50.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 msgr2=0x7f477c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:50.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 0x7f477c06e110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f479c0c2690 tx=0x7f47900015d0 comp rx=0 tx=0).stop 2024-03-19T06:06:50.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 msgr2=0x7f479c1f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:50.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f479400e200 tx=0x7f4794009750 comp rx=0 tx=0).stop 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 shutdown_connections 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f479c155510 0x7f479c1f1af0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f477c06bc50 0x7f477c06e110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f479c1550b0 0x7f479c1f15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 --2- 172.21.15.17:0/1671958510 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f47840051c0 0x7f479c0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 >> 172.21.15.17:0/1671958510 conn(0x7f479c0c8910 msgr2=0x7f479c14ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.556+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 shutdown_connections 2024-03-19T06:06:50.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:50.557+0000 7f47a4400640 1 -- 172.21.15.17:0/1671958510 wait complete. 2024-03-19T06:06:51.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-19T06:06:34.436434+0000', 'modified': '2024-03-19T06:06:44.258202+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6839/3325197099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3325197099}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3325197099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-03-19T06:06:51.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-19T06:06:51.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-19T06:06:51.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.418+0000 7fa1afc00640 1 Processor -- start 2024-03-19T06:06:51.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.418+0000 7fa1afc00640 1 -- start start 2024-03-19T06:06:51.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.420+0000 7fa1afc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa1a80c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.420+0000 7fa1afc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa1a815ae50 0x7fa1a8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.420+0000 7fa1afc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a8157650 con 0x7fa1a80c72d0 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.420+0000 7fa1afc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a815a120 con 0x7fa1a815ae50 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.420+0000 7fa1afc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8157930 con 0x7fa1a8150dc0 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.421+0000 7fa1adc00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa1a80c72d0 0x7fa1a806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44568/0 (socket says 172.21.15.17:44568) 2024-03-19T06:06:51.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.421+0000 7fa1adc00640 1 -- 172.21.15.17:0/3729606626 learned_addr learned my addr 172.21.15.17:0/3729606626 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:51.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.421+0000 7fa19fe00640 1 --2- 172.21.15.17:0/3729606626 >> v2:172.21.15.153:3300/0 conn(0x7fa1a815ae50 0x7fa1a8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.422+0000 7fa1ad200640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa1a80c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.424+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824586957 0 0) 0x7fa1a8157650 con 0x7fa1a80c72d0 2024-03-19T06:06:51.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.424+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa18c003520 con 0x7fa1a80c72d0 2024-03-19T06:06:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098221266 0 0) 0x7fa18c003520 con 0x7fa1a80c72d0 2024-03-19T06:06:51.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 msgr2=0x7fa1a80c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa1a80c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 >> v2:172.21.15.153:3300/0 conn(0x7fa1a815ae50 msgr2=0x7fa1a8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 --2- 172.21.15.17:0/3729606626 >> v2:172.21.15.153:3300/0 conn(0x7fa1a815ae50 0x7fa1a8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a815a370 con 0x7fa1a80c72d0 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fa1a00019f0 con 0x7fa1a80c72d0 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 >> v1:172.21.15.17:6789/0 conn(0x7fa1a80c72d0 legacy=0x7fa1a806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa18c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c004800 0x7fa18c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa18c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a815a120 con 0x7fa18c0039b0 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8157930 con 0x7fa18c004800 2024-03-19T06:06:51.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.428+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c00dbd0 con 0x7fa1a8150dc0 2024-03-19T06:06:51.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.433+0000 7fa1ad200640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa18c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.435+0000 7fa19fe00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c004800 0x7fa18c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.437+0000 7fa1adc00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa18c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.439+0000 7fa1ad200640 1 -- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 msgr2=0x7fa18c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.439+0000 7fa1ad200640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8150dc0 0x7fa18c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.439+0000 7fa1ad200640 1 -- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c004800 msgr2=0x7fa18c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.439+0000 7fa1ad200640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa18c004800 0x7fa18c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.439+0000 7fa1ad200640 1 -- 172.21.15.17:0/3729606626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c003520 con 0x7fa18c0039b0 2024-03-19T06:06:51.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.445+0000 7fa1ad200640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa18c003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa198009ac0 tx=0x7fa18c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20828ff43569a72 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.457+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198039070 con 0x7fa18c0039b0 2024-03-19T06:06:51.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.457+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19802c6b0 con 0x7fa18c0039b0 2024-03-19T06:06:51.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.457+0000 7fa1a7e00640 1 -- 172.21.15.17:0/3729606626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198009690 con 0x7fa18c0039b0 2024-03-19T06:06:51.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.458+0000 7fa1afc00640 1 -- 172.21.15.17:0/3729606626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 msgr2=0x7fa18c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.458+0000 7fa1afc00640 1 --2- 172.21.15.17:0/3729606626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa18c003dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa198009ac0 tx=0x7fa18c005830 comp rx=0 tx=0).stop 2024-03-19T06:06:51.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.458+0000 7fa1adc00640 1 -- 172.21.15.17:0/3729606626 reap_dead start 2024-03-19T06:06:51.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.459+0000 7fa1afc00640 1 -- 172.21.15.17:0/3729606626 shutdown_connections 2024-03-19T06:06:51.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.459+0000 7fa1afc00640 1 -- 172.21.15.17:0/3729606626 >> 172.21.15.17:0/3729606626 conn(0x7fa1a80c8910 msgr2=0x7fa1a80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:51.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.459+0000 7fa1afc00640 1 -- 172.21.15.17:0/3729606626 shutdown_connections 2024-03-19T06:06:51.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.459+0000 7fa1afc00640 1 -- 172.21.15.17:0/3729606626 wait complete. 2024-03-19T06:06:51.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.463+0000 7fa1afc00640 1 Processor -- start 2024-03-19T06:06:51.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.463+0000 7fa1afc00640 1 -- start start 2024-03-19T06:06:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8153290 0x7fa1a8149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1a814a270 0x7fa1a80c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a81511a0 con 0x7fa18c0039b0 2024-03-19T06:06:51.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a815a930 con 0x7fa1a814a270 2024-03-19T06:06:51.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.464+0000 7fa1afc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a806ee30 con 0x7fa1a8153290 2024-03-19T06:06:51.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.465+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.466+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57482/0 (socket says 172.21.15.17:57482) 2024-03-19T06:06:51.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.466+0000 7fa1ad200640 1 -- 172.21.15.17:0/594937805 learned_addr learned my addr 172.21.15.17:0/594937805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:51.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.466+0000 7fa1adc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1a814a270 0x7fa1a80c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.466+0000 7fa19fe00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8153290 0x7fa1a8149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.471+0000 7fa1ad200640 1 -- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8153290 msgr2=0x7fa1a8149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.471+0000 7fa1ad200640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8153290 0x7fa1a8149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.471+0000 7fa1ad200640 1 -- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1a814a270 msgr2=0x7fa1a80c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.471+0000 7fa1ad200640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1a814a270 0x7fa1a80c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.471+0000 7fa1ad200640 1 -- 172.21.15.17:0/594937805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a81f8070 con 0x7fa18c0039b0 2024-03-19T06:06:51.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.474+0000 7fa1ad200640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa198000c00 tx=0x7fa198004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.477+0000 7fa1a5600640 1 -- 172.21.15.17:0/594937805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198043020 con 0x7fa18c0039b0 2024-03-19T06:06:51.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.477+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80c0a60 con 0x7fa18c0039b0 2024-03-19T06:06:51.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.478+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a80c1000 con 0x7fa18c0039b0 2024-03-19T06:06:51.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.479+0000 7fa1a5600640 1 -- 172.21.15.17:0/594937805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1980044c0 con 0x7fa18c0039b0 2024-03-19T06:06:51.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.479+0000 7fa1a5600640 1 -- 172.21.15.17:0/594937805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198039040 con 0x7fa18c0039b0 2024-03-19T06:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.482+0000 7fa1b2830740 1 Processor -- start 2024-03-19T06:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.482+0000 7fa1b2830740 1 -- start start 2024-03-19T06:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d929c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d929c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92006f0 con 0x55c9d929c040 2024-03-19T06:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d91a99e0 con 0x55c9d929aaa0 2024-03-19T06:06:51.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.483+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d91fc790 con 0x55c9d92e5ec0 2024-03-19T06:06:51.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.485+0000 7fa19fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.486+0000 7fa19fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41240/0 (socket says 172.21.15.17:41240) 2024-03-19T06:06:51.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.486+0000 7fa19fe00640 1 -- 172.21.15.17:0/903462203 learned_addr learned my addr 172.21.15.17:0/903462203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:51.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.486+0000 7fa1ad200640 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d929c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.491+0000 7fa1adc00640 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d929c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.492+0000 7fa19fe00640 1 -- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 msgr2=0x55c9d929c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.492+0000 7fa19fe00640 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d929c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.493+0000 7fa19fe00640 1 -- 172.21.15.17:0/903462203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 msgr2=0x55c9d929c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.493+0000 7fa19fe00640 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d929c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.493+0000 7fa19fe00640 1 -- 172.21.15.17:0/903462203 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d919d720 con 0x55c9d929aaa0 2024-03-19T06:06:51.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.498+0000 7fa19fe00640 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa190009c30 tx=0x7fa190014780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc30adb34f0889d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.507+0000 7fa1a5600640 1 -- 172.21.15.17:0/594937805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa198046020 con 0x7fa18c0039b0 2024-03-19T06:06:51.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.508+0000 7fa1a5600640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 0x7fa18406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.509+0000 7fa1adc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 0x7fa18406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.510+0000 7fa19d600640 1 -- 172.21.15.17:0/903462203 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa190022070 con 0x55c9d929aaa0 2024-03-19T06:06:51.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.510+0000 7fa19d600640 1 -- 172.21.15.17:0/903462203 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19001d440 con 0x55c9d929aaa0 2024-03-19T06:06:51.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.510+0000 7fa19d600640 1 -- 172.21.15.17:0/903462203 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19001d830 con 0x55c9d929aaa0 2024-03-19T06:06:51.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.510+0000 7fa1adc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 0x7fa18406e030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80cc2a0 tx=0x7fa1a0002110 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.510+0000 7fa1a5600640 1 -- 172.21.15.17:0/594937805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa198079050 con 0x7fa18c0039b0 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 -- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 msgr2=0x55c9d92db8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa190009c30 tx=0x7fa190014780 comp rx=0 tx=0).stop 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 -- 172.21.15.17:0/903462203 shutdown_connections 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d929aaa0 0x55c9d92db8a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d929c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 --2- 172.21.15.17:0/903462203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d929c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 -- 172.21.15.17:0/903462203 >> 172.21.15.17:0/903462203 conn(0x55c9d92987b0 msgr2=0x55c9d929b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 -- 172.21.15.17:0/903462203 shutdown_connections 2024-03-19T06:06:51.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.511+0000 7fa1b2830740 1 -- 172.21.15.17:0/903462203 wait complete. 2024-03-19T06:06:51.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.512+0000 7fa1b2830740 1 -- start start 2024-03-19T06:06:51.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.513+0000 7fa1b2830740 1 Processor -- start 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d92dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e1b80 0x55c9d92bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92c15a0 con 0x55c9d929c040 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d91bce20 con 0x55c9d92e5ec0 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d9299960 con 0x55c9d92e1b80 2024-03-19T06:06:51.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.514+0000 7fa1b2830740 10 client.0 _ll_register_callbacks cb 0x55c9d91f78d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:06:51.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.515+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.515+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57502/0 (socket says 172.21.15.17:57502) 2024-03-19T06:06:51.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.515+0000 7fa1ad200640 1 -- 172.21.15.17:0/1440854260 learned_addr learned my addr 172.21.15.17:0/1440854260 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:51.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.516+0000 7fa19fe00640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d92dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.516+0000 7fa1adc00640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e1b80 0x55c9d92bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.519+0000 7fa1ad200640 1 -- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e1b80 msgr2=0x55c9d92bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.519+0000 7fa1ad200640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e1b80 0x55c9d92bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.519+0000 7fa1ad200640 1 -- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 msgr2=0x55c9d92dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.519+0000 7fa1ad200640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d92dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.519+0000 7fa1ad200640 1 -- 172.21.15.17:0/1440854260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9d8f152d0 con 0x55c9d929c040 2024-03-19T06:06:51.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.521+0000 7fa1ad200640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa198083190 tx=0x7fa19802d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9022bfb27226207d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.521+0000 7fa196000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:06:51.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.526+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1980a9060 con 0x55c9d929c040 2024-03-19T06:06:51.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.526+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa1980aabf0 con 0x55c9d929c040 2024-03-19T06:06:51.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.526+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa19001d440 con 0x55c9d929c040 2024-03-19T06:06:51.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.527+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1980aadf0 con 0x55c9d929c040 2024-03-19T06:06:51.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.528+0000 7fa1b2830740 10 client.4341 fetch_fsmap learned FSMap version 8 2024-03-19T06:06:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.528+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c9d8fdf6b0 con 0x55c9d929c040 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19001d440 con 0x55c9d929c040 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fa198083230 con 0x55c9d929c040 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 10 client.4341 fetch_fsmap finished waiting for FSMap version 8 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 10 client.4341 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 20 client.4341 populate_metadata read hostname 'smithi017' 2024-03-19T06:06:51.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c0370 0x55c9d92fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 4 client.4341 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:06:51.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.534+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 --> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9d920dc30 con 0x55c9d92c0370 2024-03-19T06:06:51.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.547+0000 7fa19fe00640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c0370 0x55c9d92fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.669+0000 7fa19fe00640 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c0370 0x55c9d92fbed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=456567a8f35cbfa2 server_cookie=ba3bd90a7560adc in_seq=0 out_seq=0 2024-03-19T06:06:51.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.669+0000 7fa196000640 10 client.4341 ms_handle_connect on v2:172.21.15.17:6838/3325197099 2024-03-19T06:06:51.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.902+0000 7fa196000640 1 -- 172.21.15.17:0/1440854260 <== mds.0 v2:172.21.15.17:6838/3325197099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c9d920dc30 con 0x55c9d92c0370 2024-03-19T06:06:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.902+0000 7fa196000640 10 client.4341 handle_command_reply: tid=0 2024-03-19T06:06:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.903+0000 7fa1b2830740 1 client.4341 shutdown 2024-03-19T06:06:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.903+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 msgr2=0x55c9d92ee790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.903+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa198083190 tx=0x7fa19802d780 comp rx=0 tx=0).stop 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 shutdown_connections 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c0370 0x55c9d92fbed0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e1b80 0x55c9d92bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d92dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1440854260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92ee790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa196000640 0 client.4341 ms_handle_reset on v2:172.21.15.17:6838/3325197099 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 >> 172.21.15.17:0/1440854260 conn(0x55c9d929aaa0 msgr2=0x55c9d92dd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 shutdown_connections 2024-03-19T06:06:51.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.904+0000 7fa1b2830740 1 -- 172.21.15.17:0/1440854260 wait complete. 2024-03-19T06:06:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.905+0000 7fa1b2830740 20 client.4341 trim_cache size 0 max 16384 2024-03-19T06:06:51.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.965+0000 7fa1b2830740 1 Processor -- start 2024-03-19T06:06:51.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.965+0000 7fa1b2830740 1 -- start start 2024-03-19T06:06:51.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e1b80 0x55c9d92ffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18000cbf0 con 0x55c9d929c040 2024-03-19T06:06:51.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92c15a0 con 0x55c9d92e1b80 2024-03-19T06:06:51.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.967+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92c3280 con 0x55c9d92e5ec0 2024-03-19T06:06:51.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.969+0000 7fa1adc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.970+0000 7fa1adc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:40134/0 (socket says 172.21.15.17:40134) 2024-03-19T06:06:51.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.970+0000 7fa1adc00640 1 -- 172.21.15.17:0/1830033021 learned_addr learned my addr 172.21.15.17:0/1830033021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.977+0000 7fa1adc00640 1 -- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e1b80 msgr2=0x55c9d92ffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.977+0000 7fa1adc00640 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e1b80 0x55c9d92ffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.977+0000 7fa1adc00640 1 -- 172.21.15.17:0/1830033021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 msgr2=0x55c9d92955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.977+0000 7fa1adc00640 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.977+0000 7fa1adc00640 1 -- 172.21.15.17:0/1830033021 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9d92bd7f0 con 0x55c9d92e5ec0 2024-03-19T06:06:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.983+0000 7fa1adc00640 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80c7780 tx=0x7fa1a0015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639158aaa8648f29 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:51.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.995+0000 7fa19cc00640 1 -- 172.21.15.17:0/1830033021 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0023410 con 0x55c9d92e5ec0 2024-03-19T06:06:51.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.995+0000 7fa19cc00640 1 -- 172.21.15.17:0/1830033021 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0028070 con 0x55c9d92e5ec0 2024-03-19T06:06:51.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.995+0000 7fa19cc00640 1 -- 172.21.15.17:0/1830033021 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00237d0 con 0x55c9d92e5ec0 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 -- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 msgr2=0x55c9d9300430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80c7780 tx=0x7fa1a0015000 comp rx=0 tx=0).stop 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 -- 172.21.15.17:0/1830033021 shutdown_connections 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d92e5ec0 0x55c9d9300430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e1b80 0x55c9d92ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 --2- 172.21.15.17:0/1830033021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d929c040 0x55c9d92955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 -- 172.21.15.17:0/1830033021 >> 172.21.15.17:0/1830033021 conn(0x55c9d929aaa0 msgr2=0x55c9d92dbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 -- 172.21.15.17:0/1830033021 shutdown_connections 2024-03-19T06:06:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.997+0000 7fa1b2830740 1 -- 172.21.15.17:0/1830033021 wait complete. 2024-03-19T06:06:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:51.999+0000 7fa1b2830740 1 -- start start 2024-03-19T06:06:51.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.000+0000 7fa1b2830740 1 Processor -- start 2024-03-19T06:06:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d92e1b80 0x55c9d934d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d93430a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92c07a0 con 0x55c9d92e1b80 2024-03-19T06:06:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9d929da80 con 0x55c9d92e5ec0 2024-03-19T06:06:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9d92f0af0 con 0x55c9d929c040 2024-03-19T06:06:51.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.002+0000 7fa1b2830740 10 client.0 _ll_register_callbacks cb 0x7fa1900096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:06:51.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.004+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.005+0000 7fa1ad200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:40140/0 (socket says 172.21.15.17:40140) 2024-03-19T06:06:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.005+0000 7fa1ad200640 1 -- 172.21.15.17:0/4185540905 learned_addr learned my addr 172.21.15.17:0/4185540905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.014+0000 7fa1ad200640 1 -- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 msgr2=0x55c9d93430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.014+0000 7fa1ad200640 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d93430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.014+0000 7fa1ad200640 1 -- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d92e1b80 msgr2=0x55c9d934d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.014+0000 7fa1ad200640 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d92e1b80 0x55c9d934d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.014+0000 7fa1ad200640 1 -- 172.21.15.17:0/4185540905 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9d9298040 con 0x55c9d929c040 2024-03-19T06:06:52.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.029+0000 7fa1ad200640 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa198077410 tx=0x7fa1980aafc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b83a1417f914e119 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:52.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.029+0000 7fa196000640 10 client.0 ms_handle_connect on v2:172.21.15.153:3301/0 2024-03-19T06:06:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.128+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198077250 con 0x55c9d929c040 2024-03-19T06:06:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.128+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mon.2 v2:172.21.15.153:3301/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa198083230 con 0x55c9d929c040 2024-03-19T06:06:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.128+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1a0028070 con 0x55c9d929c040 2024-03-19T06:06:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.141+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa19808a050 con 0x55c9d929c040 2024-03-19T06:06:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.141+0000 7fa1b2830740 10 client.4322 fetch_fsmap learned FSMap version 8 2024-03-19T06:06:52.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.141+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c9d934d660 con 0x55c9d929c040 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mon.2 v2:172.21.15.153:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0028070 con 0x55c9d929c040 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mon.2 v2:172.21.15.153:3301/0 5 ==== fsmap(e 8) v1 ==== 4452+0+0 (secure 0 0 0) 0x7fa19808d020 con 0x55c9d929c040 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 10 client.4322 fetch_fsmap finished waiting for FSMap version 8 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 10 client.4322 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 20 client.4322 populate_metadata read hostname 'smithi017' 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c1d80 0x55c9d92c2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 4 client.4322 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:06:52.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.187+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 --> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c9d9207f80 con 0x55c9d92c1d80 2024-03-19T06:06:52.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.189+0000 7fa19fe00640 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c1d80 0x55c9d92c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.197+0000 7fa19fe00640 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c1d80 0x55c9d92c2160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e448665c8952a889 server_cookie=4c9b9de446c8a515 in_seq=0 out_seq=0 2024-03-19T06:06:52.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.197+0000 7fa196000640 10 client.4322 ms_handle_connect on v2:172.21.15.17:6838/3325197099 2024-03-19T06:06:52.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.232+0000 7fa196000640 1 -- 172.21.15.17:0/4185540905 <== mds.0 v2:172.21.15.17:6838/3325197099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c9d9207f80 con 0x55c9d92c1d80 2024-03-19T06:06:52.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.232+0000 7fa196000640 10 client.4322 handle_command_reply: tid=0 2024-03-19T06:06:52.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.232+0000 7fa1b2830740 1 client.4322 shutdown 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.232+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 msgr2=0x55c9d93002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa198077410 tx=0x7fa1980aafc0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 shutdown_connections 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x55c9d92c1d80 0x55c9d92c2160 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c9d92e5ec0 0x55c9d93430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55c9d92e1b80 0x55c9d934d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 --2- 172.21.15.17:0/4185540905 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55c9d929c040 0x55c9d93002f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa196000640 0 client.4322 ms_handle_reset on v2:172.21.15.17:6838/3325197099 2024-03-19T06:06:52.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 >> 172.21.15.17:0/4185540905 conn(0x55c9d929aaa0 msgr2=0x55c9d92955a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 shutdown_connections 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.233+0000 7fa1b2830740 1 -- 172.21.15.17:0/4185540905 wait complete. 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.234+0000 7fa1b2830740 20 client.4322 trim_cache size 0 max 16384 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:06:52.225 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4279, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 15.575057419, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 8, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 30, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 30, 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 30.562070010999999 2024-03-19T06:06:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.235+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 msgr2=0x7fa18406e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.235+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 0x7fa18406e030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa1a80cc2a0 tx=0x7fa1a0002110 comp rx=0 tx=0).stop 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.235+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 msgr2=0x7fa1a81f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.235+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa198000c00 tx=0x7fa198004730 comp rx=0 tx=0).stop 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 shutdown_connections 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa18406bb70 0x7fa18406e030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1a814a270 0x7fa1a80c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa1a8153290 0x7fa1a8149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 --2- 172.21.15.17:0/594937805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa18c0039b0 0x7fa1a81f7b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 >> 172.21.15.17:0/594937805 conn(0x7fa1a80c8910 msgr2=0x7fa1a8072820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:52.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 shutdown_connections 2024-03-19T06:06:52.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.236+0000 7fa1afc00640 1 -- 172.21.15.17:0/594937805 wait complete. 2024-03-19T06:06:52.255 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:06:52.255 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:52.256 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:06:52.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.487+0000 7f6359000640 1 Processor -- start 2024-03-19T06:06:52.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.487+0000 7f6359000640 1 -- start start 2024-03-19T06:06:52.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.488+0000 7f6359000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6354150cc0 0x7f635415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.489+0000 7f6359000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540c5cf0 con 0x7f63540c8970 2024-03-19T06:06:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.489+0000 7f6359000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540c28f0 con 0x7f63540c6d40 2024-03-19T06:06:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.489+0000 7f6359000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63541510a0 con 0x7f6354150cc0 2024-03-19T06:06:52.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.490+0000 7f6353400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6354150cc0 0x7f635415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.490+0000 7f6353e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f63540c8970 0x7f63541611d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44576/0 (socket says 172.21.15.17:44576) 2024-03-19T06:06:52.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.490+0000 7f6353e00640 1 -- 172.21.15.17:0/967763652 learned_addr learned my addr 172.21.15.17:0/967763652 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:06:52.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.495+0000 7f6353400640 1 -- 172.21.15.17:0/967763652 >> v1:172.21.15.153:6789/0 conn(0x7f63540c6d40 legacy=0x7f63540c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.495+0000 7f6353400640 1 -- 172.21.15.17:0/967763652 >> v1:172.21.15.17:6789/0 conn(0x7f63540c8970 legacy=0x7f63541611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.495+0000 7f6353400640 1 -- 172.21.15.17:0/967763652 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540c2bd0 con 0x7f6354150cc0 2024-03-19T06:06:52.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.499+0000 7f6353400640 1 --2- 172.21.15.17:0/967763652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f635415a4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b444dd0dd908d626 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:52.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.504+0000 7f6352000640 1 -- 172.21.15.17:0/967763652 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634403b070 con 0x7f6354150cc0 2024-03-19T06:06:52.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.504+0000 7f6352000640 1 -- 172.21.15.17:0/967763652 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344036440 con 0x7f6354150cc0 2024-03-19T06:06:52.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.504+0000 7f6352000640 1 -- 172.21.15.17:0/967763652 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344036810 con 0x7f6354150cc0 2024-03-19T06:06:52.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.504+0000 7f6359000640 1 -- 172.21.15.17:0/967763652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 msgr2=0x7f635415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.504+0000 7f6359000640 1 --2- 172.21.15.17:0/967763652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f635415a4e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6344009d90 tx=0x7f634402e0c0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.505+0000 7f6359000640 1 -- 172.21.15.17:0/967763652 shutdown_connections 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.505+0000 7f6359000640 1 --2- 172.21.15.17:0/967763652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f635415a4e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.505+0000 7f6359000640 1 -- 172.21.15.17:0/967763652 >> 172.21.15.17:0/967763652 conn(0x7f635406e630 msgr2=0x7f635406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.505+0000 7f6359000640 1 -- 172.21.15.17:0/967763652 shutdown_connections 2024-03-19T06:06:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.505+0000 7f6359000640 1 -- 172.21.15.17:0/967763652 wait complete. 2024-03-19T06:06:52.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.507+0000 7f6359000640 1 Processor -- start 2024-03-19T06:06:52.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.507+0000 7f6359000640 1 -- start start 2024-03-19T06:06:52.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63540c6d40 0x7f6354158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63540c8970 0x7f63541efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354072290 con 0x7f6354150cc0 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63540c2eb0 con 0x7f63540c6d40 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6359000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6354072410 con 0x7f63540c8970 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.508+0000 7f6353e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.509+0000 7f6353e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57554/0 (socket says 172.21.15.17:57554) 2024-03-19T06:06:52.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.509+0000 7f6353e00640 1 -- 172.21.15.17:0/1072941891 learned_addr learned my addr 172.21.15.17:0/1072941891 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:52.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.509+0000 7f6353400640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63540c6d40 0x7f6354158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.509+0000 7f6352a00640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63540c8970 0x7f63541efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.513+0000 7f6353e00640 1 -- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63540c8970 msgr2=0x7f63541efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.513+0000 7f6353e00640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63540c8970 0x7f63541efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.513+0000 7f6353e00640 1 -- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63540c6d40 msgr2=0x7f6354158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.513+0000 7f6353e00640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63540c6d40 0x7f6354158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:52.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.513+0000 7f6353e00640 1 -- 172.21.15.17:0/1072941891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354151dd0 con 0x7f6354150cc0 2024-03-19T06:06:52.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.515+0000 7f6353e00640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c420 tx=0x7f634c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.520+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c017070 con 0x7f6354150cc0 2024-03-19T06:06:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.520+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c005ce0 con 0x7f6354150cc0 2024-03-19T06:06:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.520+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c0072d0 con 0x7f6354150cc0 2024-03-19T06:06:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.520+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63541f32a0 con 0x7f6354150cc0 2024-03-19T06:06:52.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.520+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63541f3860 con 0x7f6354150cc0 2024-03-19T06:06:52.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.521+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63540686e0 con 0x7f6354150cc0 2024-03-19T06:06:52.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.857+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f634c01a070 con 0x7f6354150cc0 2024-03-19T06:06:52.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.859+0000 7f634b400640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 0x7f633006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:52.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.860+0000 7f6353400640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 0x7f633006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:52.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.861+0000 7f6353400640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 0x7f633006e0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6344038000 tx=0x7f634400d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:52.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.896+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f634c01de30 con 0x7f6354150cc0 2024-03-19T06:06:52.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:52.897+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f634c058a10 con 0x7f6354150cc0 2024-03-19T06:06:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.170+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6354147790 con 0x7f6354150cc0 2024-03-19T06:06:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.187+0000 7f634b400640 1 -- 172.21.15.17:0/1072941891 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f634c05cab0 con 0x7f6354150cc0 2024-03-19T06:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-19T06:06:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 msgr2=0x7f633006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 0x7f633006e0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6344038000 tx=0x7f634400d040 comp rx=0 tx=0).stop 2024-03-19T06:06:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 msgr2=0x7f63541f0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c420 tx=0x7f634c00c8e0 comp rx=0 tx=0).stop 2024-03-19T06:06:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 shutdown_connections 2024-03-19T06:06:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6354150cc0 0x7f63541f0060 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f63540c8970 0x7f63541efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f633006bc20 0x7f633006e0e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 --2- 172.21.15.17:0/1072941891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63540c6d40 0x7f6354158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 >> 172.21.15.17:0/1072941891 conn(0x7f635406e630 msgr2=0x7f63540cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 shutdown_connections 2024-03-19T06:06:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:53.190+0000 7f6359000640 1 -- 172.21.15.17:0/1072941891 wait complete. 2024-03-19T06:06:53.201 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-19T06:06:53.201 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:06:53.201 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-19T06:06:53.201 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-19T06:06:53.201 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:53.202 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-19T06:06:53.202 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:06:53.202 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:06:53.202 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-19T06:06:53.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:53.202 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-19T06:06:53.254 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42083sec preferred_lft 42083sec 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:06:53.255 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-19T06:06:53.257 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:06:53.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:06:53.257 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:06:53.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:53.766 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:06:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-19T06:06:53.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:53.849 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-19T06:06:53.909 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-19T06:06:53.909 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:06:53.909 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-19T06:06:53.909 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-19T06:06:53.909 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:06:53.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:06:53.910 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:06:54.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:54.635 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-19T06:06:54.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:54.685 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-03-19T06:06:54.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:54.774 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:06:54.774 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:06:54.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:54.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-19T06:06:54.774 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:06:54.949 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-19T06:06:54.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-19T06:06:54.950 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:06:55.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:55.231 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:06:55.231 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:06:55.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-19T06:06:55.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:06:55.231 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:06:55.385 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-19T06:06:55.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:06:55.385 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:55.428 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-19T06:06:55.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:06:55.428 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:55.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:06:55.643 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:06:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:06:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:06:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:06:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:06:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:55.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:55.690 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:06:55.787 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:06:55.787 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-19T06:06:55.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:06:55.874 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:06:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:06:55.918 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:55.919 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:55.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:55.920 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:06:56.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:2024-03-19T06:06:56.011+0000 7fb6985db480 -1 init, newargv = 0x5562759342d0 newargc=15 2024-03-19T06:06:56.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[42418]: starting ceph client 2024-03-19T06:06:56.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[42418]: starting fuse 2024-03-19T06:06:57.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:06:57.364 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:06:57.422 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:06:57.422 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:06:57.422 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:06:57.423 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:57.424 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:06:57.425 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:57.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:57.426 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:06:57.474 INFO:teuthology.orchestra.run.smithi017.stdout:41 2024-03-19T06:06:57.475 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:06:57.475 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.admin")) 2024-03-19T06:06:57.476 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-19T06:06:57.656 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.admin.42418.asok 2024-03-19T06:06:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:06:57.676 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42418.asok 2024-03-19T06:06:57.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:57.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42418.asok status 2024-03-19T06:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "admin", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "42418", 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4359, 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-03-19T06:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4359 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 228226575 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 228226575 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4359 192.168.0.1:0/228226575", 2024-03-19T06:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/228226575", 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 8, 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 30, 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-03-19T06:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:06:57.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:57.931 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-03-19T06:06:57.931 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-03-19T06:06:58.003 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:58.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:58.003 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:06:58.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:06:58.185 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-19T06:06:58.672 INFO:teuthology.orchestra.run.smithi017.stdout:# file: . 2024-03-19T06:06:58.672 INFO:teuthology.orchestra.run.smithi017.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-19T06:06:58.672 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:58.674 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:06:58.674 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:06:58.731 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:06:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.963+0000 7f9ecba00640 1 Processor -- start 2024-03-19T06:06:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.963+0000 7f9ecba00640 1 -- start start 2024-03-19T06:06:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.965+0000 7f9ecba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.965+0000 7f9ecba00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ec40c4750 0x7f9ec40c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.965+0000 7f9ecba00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec40c5120 con 0x7f9ec41505c0 2024-03-19T06:06:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.965+0000 7f9ecba00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec4070c30 con 0x7f9ec40c4750 2024-03-19T06:06:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.965+0000 7f9ecba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c3f90 con 0x7f9ec40c5330 2024-03-19T06:06:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.967+0000 7f9ec3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.967+0000 7f9ec9a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ec40c4750 0x7f9ec40c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.968+0000 7f9ec3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:40164/0 (socket says 172.21.15.17:40164) 2024-03-19T06:06:58.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.968+0000 7f9ec3e00640 1 -- 172.21.15.17:0/719931080 learned_addr learned my addr 172.21.15.17:0/719931080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.975+0000 7f9ec3e00640 1 -- 172.21.15.17:0/719931080 >> v2:172.21.15.153:3300/0 conn(0x7f9ec40c4750 msgr2=0x7f9ec40c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:06:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.975+0000 7f9ec3e00640 1 --2- 172.21.15.17:0/719931080 >> v2:172.21.15.153:3300/0 conn(0x7f9ec40c4750 0x7f9ec40c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.975+0000 7f9ec3e00640 1 -- 172.21.15.17:0/719931080 >> v1:172.21.15.153:6789/0 conn(0x7f9ec41505c0 legacy=0x7f9ec406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.975+0000 7f9ec3e00640 1 -- 172.21.15.17:0/719931080 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4070ed0 con 0x7f9ec40c5330 2024-03-19T06:06:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.981+0000 7f9ec3e00640 1 --2- 172.21.15.17:0/719931080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009870 tx=0x7f9eb002dc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feec35908fb4868a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:58.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.991+0000 7f9ec3400640 1 -- 172.21.15.17:0/719931080 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb003b070 con 0x7f9ec40c5330 2024-03-19T06:06:58.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.991+0000 7f9ec3400640 1 -- 172.21.15.17:0/719931080 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb002e9d0 con 0x7f9ec40c5330 2024-03-19T06:06:58.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.991+0000 7f9ec3400640 1 -- 172.21.15.17:0/719931080 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb002eda0 con 0x7f9ec40c5330 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.991+0000 7f9ecba00640 1 -- 172.21.15.17:0/719931080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 msgr2=0x7f9ec40c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.991+0000 7f9ecba00640 1 --2- 172.21.15.17:0/719931080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0009870 tx=0x7f9eb002dc20 comp rx=0 tx=0).stop 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 -- 172.21.15.17:0/719931080 shutdown_connections 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 --2- 172.21.15.17:0/719931080 >> v2:172.21.15.153:3300/0 conn(0x7f9ec40c4750 0x7f9ec40c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 --2- 172.21.15.17:0/719931080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c5330 0x7f9ec40c7820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 -- 172.21.15.17:0/719931080 >> 172.21.15.17:0/719931080 conn(0x7f9ec40c8910 msgr2=0x7f9ec40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 -- 172.21.15.17:0/719931080 shutdown_connections 2024-03-19T06:06:58.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.992+0000 7f9ecba00640 1 -- 172.21.15.17:0/719931080 wait complete. 2024-03-19T06:06:58.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.994+0000 7f9ecba00640 1 Processor -- start 2024-03-19T06:06:58.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.994+0000 7f9ecba00640 1 -- start start 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c4750 0x7f9ec41ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ec40c5330 0x7f9ec41dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4157270 con 0x7f9ec41505c0 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c4230 con 0x7f9ec40c5330 2024-03-19T06:06:58.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.995+0000 7f9ecba00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41509a0 con 0x7f9ec40c4750 2024-03-19T06:06:58.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.996+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:58.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.997+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57556/0 (socket says 172.21.15.17:57556) 2024-03-19T06:06:58.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.997+0000 7f9ec9a00640 1 -- 172.21.15.17:0/322997870 learned_addr learned my addr 172.21.15.17:0/322997870 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:06:58.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.997+0000 7f9ec3e00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ec40c5330 0x7f9ec41dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:58.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:58.998+0000 7f9ec9000640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c4750 0x7f9ec41ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.002+0000 7f9ec9a00640 1 -- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c4750 msgr2=0x7f9ec41ec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.002+0000 7f9ec9a00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c4750 0x7f9ec41ec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.002+0000 7f9ec9a00640 1 -- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ec40c5330 msgr2=0x7f9ec41dd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:58.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.002+0000 7f9ec9a00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ec40c5330 0x7f9ec41dd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:58.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.002+0000 7f9ec9a00640 1 -- 172.21.15.17:0/322997870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec41512c0 con 0x7f9ec41505c0 2024-03-19T06:06:58.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.005+0000 7f9ec9a00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00efc0 tx=0x7f9ebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.012+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc018020 con 0x7f9ec41505c0 2024-03-19T06:06:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.013+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc014480 con 0x7f9ec41505c0 2024-03-19T06:06:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.013+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc014870 con 0x7f9ec41505c0 2024-03-19T06:06:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.013+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec414fd50 con 0x7f9ec41505c0 2024-03-19T06:06:59.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.013+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec4150fe0 con 0x7f9ec41505c0 2024-03-19T06:06:59.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.014+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec4069be0 con 0x7f9ec41505c0 2024-03-19T06:06:59.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.338+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9ebc005d10 con 0x7f9ec41505c0 2024-03-19T06:06:59.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.340+0000 7f9ec0c00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 0x7f9ea406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:06:59.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.341+0000 7f9ec9000640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 0x7f9ea406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:06:59.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.343+0000 7f9ec9000640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 0x7f9ea406e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80016e0 tx=0x7f9eb8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:06:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.376+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9ebc058150 con 0x7f9ec41505c0 2024-03-19T06:06:59.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.377+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f9ebc022070 con 0x7f9ec41505c0 2024-03-19T06:06:59.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.603+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec414dc90 con 0x7f9ec41505c0 2024-03-19T06:06:59.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.848+0000 7f9ec0c00640 1 -- 172.21.15.17:0/322997870 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+18502 (secure 0 0 0) 0x7f9ec41512c0 con 0x7f9ec41505c0 2024-03-19T06:06:59.840 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:06:59.840 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:06:44.249620+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.851+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 msgr2=0x7f9ea406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.851+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 0x7f9ea406e090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80016e0 tx=0x7f9eb8009040 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.851+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 msgr2=0x7f9ec414df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.851+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00efc0 tx=0x7f9ebc00c490 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 shutdown_connections 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ec41505c0 0x7f9ec414df30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9ea406bbd0 0x7f9ea406e090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ec40c5330 0x7f9ec41dd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 --2- 172.21.15.17:0/322997870 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ec40c4750 0x7f9ec41ec9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 >> 172.21.15.17:0/322997870 conn(0x7f9ec40c8910 msgr2=0x7f9ec4072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:06:59.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 shutdown_connections 2024-03-19T06:06:59.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:06:59.852+0000 7f9ecba00640 1 -- 172.21.15.17:0/322997870 wait complete. 2024-03-19T06:06:59.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:06:59.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:07:00.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.104+0000 7ffbe5a00640 1 Processor -- start 2024-03-19T06:07:00.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.104+0000 7ffbe5a00640 1 -- start start 2024-03-19T06:07:00.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.106+0000 7ffbe5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0153ed0 0x7ffbe015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.106+0000 7ffbe5a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffbe006eb60 0x7ffbe0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.106+0000 7ffbe5a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe01542b0 con 0x7ffbe006e720 2024-03-19T06:07:00.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.106+0000 7ffbe5a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe006ef90 con 0x7ffbe006eb60 2024-03-19T06:07:00.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.106+0000 7ffbe5a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015e1d0 con 0x7ffbe0153ed0 2024-03-19T06:07:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.107+0000 7ffbdf400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffbe006eb60 0x7ffbe0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.108+0000 7ffbdf400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffbe006eb60 0x7ffbe0070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51702/0 (socket says 172.21.15.17:51702) 2024-03-19T06:07:00.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.108+0000 7ffbdf400640 1 -- 172.21.15.17:0/3010265092 learned_addr learned my addr 172.21.15.17:0/3010265092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:00.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.108+0000 7ffbdea00640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0153ed0 0x7ffbe015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.110+0000 7ffbdf400640 1 -- 172.21.15.17:0/3010265092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0153ed0 msgr2=0x7ffbe015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.110+0000 7ffbdf400640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0153ed0 0x7ffbe015aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.110+0000 7ffbdf400640 1 -- 172.21.15.17:0/3010265092 >> v1:172.21.15.153:6789/0 conn(0x7ffbe006e720 legacy=0x7ffbe00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.110+0000 7ffbdf400640 1 -- 172.21.15.17:0/3010265092 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe015d5c0 con 0x7ffbe006eb60 2024-03-19T06:07:00.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.113+0000 7ffbdf400640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe006eb60 0x7ffbe0070d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009e50 tx=0x7ffbd802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15d7b04fafbd128 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbdd600640 1 -- 172.21.15.17:0/3010265092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd802cb00 con 0x7ffbe006eb60 2024-03-19T06:07:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbdd600640 1 -- 172.21.15.17:0/3010265092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd802cca0 con 0x7ffbe006eb60 2024-03-19T06:07:00.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbdd600640 1 -- 172.21.15.17:0/3010265092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8034610 con 0x7ffbe006eb60 2024-03-19T06:07:00.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3010265092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe006eb60 msgr2=0x7ffbe0070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe006eb60 0x7ffbe0070d30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009e50 tx=0x7ffbd802bf60 comp rx=0 tx=0).stop 2024-03-19T06:07:00.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.119+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3010265092 shutdown_connections 2024-03-19T06:07:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.120+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe006eb60 0x7ffbe0070d30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.120+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3010265092 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe0153ed0 0x7ffbe015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.120+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3010265092 >> 172.21.15.17:0/3010265092 conn(0x7ffbe00c8910 msgr2=0x7ffbe00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.120+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3010265092 shutdown_connections 2024-03-19T06:07:00.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.120+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3010265092 wait complete. 2024-03-19T06:07:00.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.121+0000 7ffbe5a00640 1 Processor -- start 2024-03-19T06:07:00.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 -- start start 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe006e720 0x7ffbe0159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe006eb60 0x7ffbe00cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015de60 con 0x7ffbe0153ed0 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe015db80 con 0x7ffbe006e720 2024-03-19T06:07:00.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.122+0000 7ffbe5a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe00c68f0 con 0x7ffbe006eb60 2024-03-19T06:07:00.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.123+0000 7ffbdf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.124+0000 7ffbdf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51718/0 (socket says 172.21.15.17:51718) 2024-03-19T06:07:00.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.124+0000 7ffbdf400640 1 -- 172.21.15.17:0/3100717471 learned_addr learned my addr 172.21.15.17:0/3100717471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:00.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.124+0000 7ffbdea00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe006e720 0x7ffbe0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.124+0000 7ffbde000640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe006eb60 0x7ffbe00cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.128+0000 7ffbdf400640 1 -- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe006eb60 msgr2=0x7ffbe00cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.128+0000 7ffbdf400640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe006eb60 0x7ffbe00cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.128+0000 7ffbdf400640 1 -- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe006e720 msgr2=0x7ffbe0159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.128+0000 7ffbdf400640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe006e720 0x7ffbe0159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.128+0000 7ffbdf400640 1 -- 172.21.15.17:0/3100717471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe014de30 con 0x7ffbe0153ed0 2024-03-19T06:07:00.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.130+0000 7ffbdf400640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8036040 tx=0x7ffbd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:00.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.134+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8043020 con 0x7ffbe0153ed0 2024-03-19T06:07:00.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.134+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd802ce50 con 0x7ffbe0153ed0 2024-03-19T06:07:00.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.134+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8009510 con 0x7ffbe0153ed0 2024-03-19T06:07:00.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.134+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe00cb760 con 0x7ffbe0153ed0 2024-03-19T06:07:00.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.135+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe00c9c10 con 0x7ffbe0153ed0 2024-03-19T06:07:00.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.136+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe0151fd0 con 0x7ffbe0153ed0 2024-03-19T06:07:00.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.448+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ffbd8046020 con 0x7ffbe0153ed0 2024-03-19T06:07:00.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.449+0000 7ffbd6a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 0x7ffbbc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:00.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.450+0000 7ffbdea00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 0x7ffbbc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:00.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.452+0000 7ffbdea00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 0x7ffbbc06e110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00079a0 tx=0x7ffbd0008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:00.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.490+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffbd80799b0 con 0x7ffbe0153ed0 2024-03-19T06:07:00.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.491+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7ffbe0151fd0 con 0x7ffbe0153ed0 2024-03-19T06:07:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.750+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbe0069be0 con 0x7ffbe0153ed0 2024-03-19T06:07:00.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.778+0000 7ffbd6a00640 1 -- 172.21.15.17:0/3100717471 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffbd804d030 con 0x7ffbe0153ed0 2024-03-19T06:07:00.769 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:07:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.781+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 msgr2=0x7ffbbc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.781+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 0x7ffbbc06e110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00079a0 tx=0x7ffbd0008040 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.781+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 msgr2=0x7ffbe015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.781+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8036040 tx=0x7ffbd8004a40 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 shutdown_connections 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffbe0153ed0 0x7ffbe015c5f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ffbe006eb60 0x7ffbe00cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ffbbc06bc50 0x7ffbbc06e110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 --2- 172.21.15.17:0/3100717471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbe006e720 0x7ffbe0159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 >> 172.21.15.17:0/3100717471 conn(0x7ffbe00c8910 msgr2=0x7ffbe006c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 shutdown_connections 2024-03-19T06:07:00.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:00.782+0000 7ffbe5a00640 1 -- 172.21.15.17:0/3100717471 wait complete. 2024-03-19T06:07:00.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:07:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.028+0000 7f0886a00640 1 Processor -- start 2024-03-19T06:07:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.028+0000 7f0886a00640 1 -- start start 2024-03-19T06:07:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.029+0000 7f0886a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0880153d70 0x7f08800c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.029+0000 7f0886a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08800ca4c0 0x7f088015d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.029+0000 7f0886a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0880154150 con 0x7f088015dd80 2024-03-19T06:07:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.029+0000 7f0886a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08800cbb50 con 0x7f0880153d70 2024-03-19T06:07:01.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.029+0000 7f0886a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088015e1b0 con 0x7f08800ca4c0 2024-03-19T06:07:01.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.039+0000 7f087fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0880153d70 0x7f08800c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.041+0000 7f087fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0880153d70 0x7f08800c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51734/0 (socket says 172.21.15.17:51734) 2024-03-19T06:07:01.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.041+0000 7f087fe00640 1 -- 172.21.15.17:0/2890552369 learned_addr learned my addr 172.21.15.17:0/2890552369 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.043+0000 7f087fe00640 1 -- 172.21.15.17:0/2890552369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08800ca4c0 msgr2=0x7f088015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.043+0000 7f087fe00640 1 --2- 172.21.15.17:0/2890552369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08800ca4c0 0x7f088015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.044+0000 7f087fe00640 1 -- 172.21.15.17:0/2890552369 >> v1:172.21.15.153:6789/0 conn(0x7f088015dd80 legacy=0x7f088006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.044+0000 7f087fe00640 1 -- 172.21.15.17:0/2890552369 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088015ac10 con 0x7f0880153d70 2024-03-19T06:07:01.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.046+0000 7f087fe00640 1 --2- 172.21.15.17:0/2890552369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0880153d70 0x7f08800c9f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08800cd090 tx=0x7f087002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd94a0d01b44a18c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:01.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.051+0000 7f087ea00640 1 -- 172.21.15.17:0/2890552369 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870034070 con 0x7f0880153d70 2024-03-19T06:07:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.051+0000 7f087ea00640 1 -- 172.21.15.17:0/2890552369 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870030610 con 0x7f0880153d70 2024-03-19T06:07:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.051+0000 7f087ea00640 1 -- 172.21.15.17:0/2890552369 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08700309e0 con 0x7f0880153d70 2024-03-19T06:07:01.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.051+0000 7f0886a00640 1 -- 172.21.15.17:0/2890552369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0880153d70 msgr2=0x7f08800c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.051+0000 7f0886a00640 1 --2- 172.21.15.17:0/2890552369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0880153d70 0x7f08800c9f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08800cd090 tx=0x7f087002b960 comp rx=0 tx=0).stop 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 -- 172.21.15.17:0/2890552369 shutdown_connections 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 --2- 172.21.15.17:0/2890552369 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f08800ca4c0 0x7f088015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 --2- 172.21.15.17:0/2890552369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0880153d70 0x7f08800c9f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 -- 172.21.15.17:0/2890552369 >> 172.21.15.17:0/2890552369 conn(0x7f0880066e10 msgr2=0x7f088006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 -- 172.21.15.17:0/2890552369 shutdown_connections 2024-03-19T06:07:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.052+0000 7f0886a00640 1 -- 172.21.15.17:0/2890552369 wait complete. 2024-03-19T06:07:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.053+0000 7f0886a00640 1 Processor -- start 2024-03-19T06:07:01.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.054+0000 7f0886a00640 1 -- start start 2024-03-19T06:07:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.054+0000 7f0886a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.054+0000 7f0886a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f088015dd80 0x7f08801efa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.054+0000 7f0886a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08801eff40 0x7f08801525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.054+0000 7f0886a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088015a650 con 0x7f08800ca4c0 2024-03-19T06:07:01.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.055+0000 7f0886a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088015a370 con 0x7f08801eff40 2024-03-19T06:07:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.055+0000 7f0886a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088015a930 con 0x7f088015dd80 2024-03-19T06:07:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.055+0000 7f087fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.056+0000 7f087fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51748/0 (socket says 172.21.15.17:51748) 2024-03-19T06:07:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.056+0000 7f087fe00640 1 -- 172.21.15.17:0/1215968906 learned_addr learned my addr 172.21.15.17:0/1215968906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.060+0000 7f087fe00640 1 -- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f088015dd80 msgr2=0x7f08801efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.060+0000 7f087fe00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f088015dd80 0x7f08801efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.060+0000 7f087fe00640 1 -- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08801eff40 msgr2=0x7f08801525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.060+0000 7f087fe00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08801eff40 0x7f08801525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.060+0000 7f087fe00640 1 -- 172.21.15.17:0/1215968906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08801f2ff0 con 0x7f08800ca4c0 2024-03-19T06:07:01.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.063+0000 7f087fe00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f087002bef0 tx=0x7f0870004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.067+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870048070 con 0x7f08800ca4c0 2024-03-19T06:07:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.067+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870039a90 con 0x7f08800ca4c0 2024-03-19T06:07:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.067+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870034040 con 0x7f08800ca4c0 2024-03-19T06:07:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.067+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0880153370 con 0x7f08800ca4c0 2024-03-19T06:07:01.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.067+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08801f3570 con 0x7f08800ca4c0 2024-03-19T06:07:01.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.069+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880069be0 con 0x7f08800ca4c0 2024-03-19T06:07:01.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.359+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f087004b070 con 0x7f08800ca4c0 2024-03-19T06:07:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.362+0000 7f0877e00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 0x7f086006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.363+0000 7f087f400640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 0x7f086006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.365+0000 7f087f400640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 0x7f086006e110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08800b1f10 tx=0x7f086c006c80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:01.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.396+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0870078f50 con 0x7f08800ca4c0 2024-03-19T06:07:01.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.414+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f0870052080 con 0x7f08800ca4c0 2024-03-19T06:07:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.629+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08800b4060 con 0x7f08800ca4c0 2024-03-19T06:07:01.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.645+0000 7f0877e00640 1 -- 172.21.15.17:0/1215968906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f087007b5b0 con 0x7f08800ca4c0 2024-03-19T06:07:01.636 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.647+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 msgr2=0x7f086006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.647+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 0x7f086006e110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f08800b1f10 tx=0x7f086c006c80 comp rx=0 tx=0).stop 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 msgr2=0x7f088014c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f087002bef0 tx=0x7f0870004730 comp rx=0 tx=0).stop 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 shutdown_connections 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f086006bc50 0x7f086006e110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08801eff40 0x7f08801525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f088015dd80 0x7f08801efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 --2- 172.21.15.17:0/1215968906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08800ca4c0 0x7f088014c8b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 >> 172.21.15.17:0/1215968906 conn(0x7f0880066e10 msgr2=0x7f08800c5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 shutdown_connections 2024-03-19T06:07:01.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.648+0000 7f0886a00640 1 -- 172.21.15.17:0/1215968906 wait complete. 2024-03-19T06:07:01.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:07:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.897+0000 7f157d000640 1 Processor -- start 2024-03-19T06:07:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.897+0000 7f157d000640 1 -- start start 2024-03-19T06:07:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.899+0000 7f157d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1578151f70 0x7f15780c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.899+0000 7f157d000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f157815b1d0 0x7f15781583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.899+0000 7f157d000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15780c27c0 con 0x7f1578158900 2024-03-19T06:07:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.899+0000 7f157d000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1578157f30 con 0x7f157815b1d0 2024-03-19T06:07:01.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.899+0000 7f157d000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1578152350 con 0x7f1578151f70 2024-03-19T06:07:01.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.905+0000 7f1575e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1578151f70 0x7f15780c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.909+0000 7f1575400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f157815b1d0 0x7f15781583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.909+0000 7f1575400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f157815b1d0 0x7f15781583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51762/0 (socket says 172.21.15.17:51762) 2024-03-19T06:07:01.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.909+0000 7f1575400640 1 -- 172.21.15.17:0/3855573448 learned_addr learned my addr 172.21.15.17:0/3855573448 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:01.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.917+0000 7f1575400640 1 -- 172.21.15.17:0/3855573448 >> v2:172.21.15.153:3300/0 conn(0x7f1578151f70 msgr2=0x7f15780c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:01.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.918+0000 7f1575400640 1 --2- 172.21.15.17:0/3855573448 >> v2:172.21.15.153:3300/0 conn(0x7f1578151f70 0x7f15780c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.918+0000 7f1575400640 1 -- 172.21.15.17:0/3855573448 >> v1:172.21.15.17:6789/0 conn(0x7f1578158900 legacy=0x7f157806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:01.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.918+0000 7f1575400640 1 -- 172.21.15.17:0/3855573448 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578157be0 con 0x7f157815b1d0 2024-03-19T06:07:01.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.923+0000 7f1575400640 1 --2- 172.21.15.17:0/3855573448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f157815b1d0 0x7f15781583c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1578072f90 tx=0x7f156402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799914e67bf3c31a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.933+0000 7f1574a00640 1 -- 172.21.15.17:0/3855573448 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564035020 con 0x7f157815b1d0 2024-03-19T06:07:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.933+0000 7f1574a00640 1 -- 172.21.15.17:0/3855573448 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1564031870 con 0x7f157815b1d0 2024-03-19T06:07:01.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.933+0000 7f1574a00640 1 -- 172.21.15.17:0/3855573448 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1564031c40 con 0x7f157815b1d0 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.934+0000 7f157d000640 1 -- 172.21.15.17:0/3855573448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f157815b1d0 msgr2=0x7f15781583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.934+0000 7f157d000640 1 --2- 172.21.15.17:0/3855573448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f157815b1d0 0x7f15781583c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1578072f90 tx=0x7f156402b910 comp rx=0 tx=0).stop 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 -- 172.21.15.17:0/3855573448 shutdown_connections 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 --2- 172.21.15.17:0/3855573448 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f157815b1d0 0x7f15781583c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 --2- 172.21.15.17:0/3855573448 >> v2:172.21.15.153:3300/0 conn(0x7f1578151f70 0x7f15780c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 -- 172.21.15.17:0/3855573448 >> 172.21.15.17:0/3855573448 conn(0x7f15780c8910 msgr2=0x7f15780cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 -- 172.21.15.17:0/3855573448 shutdown_connections 2024-03-19T06:07:01.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.935+0000 7f157d000640 1 -- 172.21.15.17:0/3855573448 wait complete. 2024-03-19T06:07:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.938+0000 7f157d000640 1 Processor -- start 2024-03-19T06:07:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.938+0000 7f157d000640 1 -- start start 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1578151f70 0x7f15780719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1578158900 0x7f1578148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157815bcf0 con 0x7f1578151f70 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157815ba10 con 0x7f157815b1d0 2024-03-19T06:07:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.940+0000 7f157d000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157815bfd0 con 0x7f1578158900 2024-03-19T06:07:01.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.942+0000 7f1575400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1578158900 0x7f1578148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.942+0000 7f1576800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:01.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.943+0000 7f1576800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:56358/0 (socket says 172.21.15.17:56358) 2024-03-19T06:07:01.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.943+0000 7f1576800640 1 -- 172.21.15.17:0/2433996486 learned_addr learned my addr 172.21.15.17:0/2433996486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:01.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.953+0000 7f1576800640 1 -- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1578158900 msgr2=0x7f1578148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.953+0000 7f1576800640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1578158900 0x7f1578148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.953+0000 7f1576800640 1 -- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1578151f70 msgr2=0x7f15780719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:01.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.953+0000 7f1576800640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1578151f70 0x7f15780719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:01.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.953+0000 7f1576800640 1 -- 172.21.15.17:0/2433996486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157814cdf0 con 0x7f157815b1d0 2024-03-19T06:07:01.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:01.962+0000 7f1576800640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f157000c780 tx=0x7f157000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:02.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.114+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1570017070 con 0x7f157815b1d0 2024-03-19T06:07:02.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.114+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1570003da0 con 0x7f157815b1d0 2024-03-19T06:07:02.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.114+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15700052b0 con 0x7f157815b1d0 2024-03-19T06:07:02.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.114+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15781f45a0 con 0x7f157815b1d0 2024-03-19T06:07:02.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.114+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1578155b00 con 0x7f157815b1d0 2024-03-19T06:07:02.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.116+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1578069be0 con 0x7f157815b1d0 2024-03-19T06:07:02.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.445+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f157001a070 con 0x7f157815b1d0 2024-03-19T06:07:02.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.447+0000 7f156e000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 0x7f155806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:02.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.448+0000 7f1575e00640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 0x7f155806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.450+0000 7f1575e00640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 0x7f155806e0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15680098f0 tx=0x7f1568008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:02.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.453+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1570056a10 con 0x7f157815b1d0 2024-03-19T06:07:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.483+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f1570021020 con 0x7f157815b1d0 2024-03-19T06:07:02.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.704+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15780c7200 con 0x7f157815b1d0 2024-03-19T06:07:02.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.712+0000 7f156e000640 1 -- 172.21.15.17:0/2433996486 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1570058970 con 0x7f157815b1d0 2024-03-19T06:07:02.703 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 msgr2=0x7f155806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 0x7f155806e0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15680098f0 tx=0x7f1568008040 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 msgr2=0x7f1578149380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f157000c780 tx=0x7f157000cc40 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 shutdown_connections 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f155806bc20 0x7f155806e0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f157815b1d0 0x7f1578149380 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1578158900 0x7f1578148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 --2- 172.21.15.17:0/2433996486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1578151f70 0x7f15780719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 >> 172.21.15.17:0/2433996486 conn(0x7f15780c8910 msgr2=0x7f157806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:02.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 shutdown_connections 2024-03-19T06:07:02.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.715+0000 7f157d000640 1 -- 172.21.15.17:0/2433996486 wait complete. 2024-03-19T06:07:02.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:07:02.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.958+0000 7fb2a8c00640 1 Processor -- start 2024-03-19T06:07:02.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.959+0000 7fb2a8c00640 1 -- start start 2024-03-19T06:07:02.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.961+0000 7fb2a8c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb2a40c4fb0 0x7fb2a4151820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:02.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.961+0000 7fb2a8c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4157b60 con 0x7fb2a4070aa0 2024-03-19T06:07:02.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.961+0000 7fb2a8c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a4157e40 con 0x7fb2a40c4bd0 2024-03-19T06:07:02.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.961+0000 7fb2a8c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4158120 con 0x7fb2a40c4fb0 2024-03-19T06:07:02.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.963+0000 7fb2a3400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb2a40c4bd0 0x7fb2a40c5c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:56602/0 (socket says 172.21.15.17:56602) 2024-03-19T06:07:02.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.963+0000 7fb2a3400640 1 -- 172.21.15.17:0/888605175 learned_addr learned my addr 172.21.15.17:0/888605175 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:02.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.964+0000 7fb29be00640 1 --2- 172.21.15.17:0/888605175 >> v2:172.21.15.153:3300/0 conn(0x7fb2a40c4fb0 0x7fb2a4151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:02.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.979+0000 7fb29be00640 1 -- 172.21.15.17:0/888605175 >> v1:172.21.15.153:6789/0 conn(0x7fb2a40c4bd0 legacy=0x7fb2a40c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:02.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.979+0000 7fb29be00640 1 -- 172.21.15.17:0/888605175 >> v1:172.21.15.17:6789/0 conn(0x7fb2a4070aa0 legacy=0x7fb2a406e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:02.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.979+0000 7fb29be00640 1 -- 172.21.15.17:0/888605175 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4158400 con 0x7fb2a40c4fb0 2024-03-19T06:07:02.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:02.998+0000 7fb29be00640 1 --2- 172.21.15.17:0/888605175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a40c4fb0 0x7fb2a4151820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097a0 tx=0x7fb28c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bda588ec88b184 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.110+0000 7fb2a2a00640 1 -- 172.21.15.17:0/888605175 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c02f810 con 0x7fb2a40c4fb0 2024-03-19T06:07:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.110+0000 7fb2a2a00640 1 -- 172.21.15.17:0/888605175 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c02f9b0 con 0x7fb2a40c4fb0 2024-03-19T06:07:03.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.110+0000 7fb2a2a00640 1 -- 172.21.15.17:0/888605175 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c02fd80 con 0x7fb2a40c4fb0 2024-03-19T06:07:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.111+0000 7fb2a8c00640 1 -- 172.21.15.17:0/888605175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a40c4fb0 msgr2=0x7fb2a4151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.111+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/888605175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a40c4fb0 0x7fb2a4151820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097a0 tx=0x7fb28c02b9f0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.111+0000 7fb2a8c00640 1 -- 172.21.15.17:0/888605175 shutdown_connections 2024-03-19T06:07:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.111+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/888605175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a40c4fb0 0x7fb2a4151820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.111+0000 7fb2a8c00640 1 -- 172.21.15.17:0/888605175 >> 172.21.15.17:0/888605175 conn(0x7fb2a406d770 msgr2=0x7fb2a406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.112+0000 7fb2a8c00640 1 -- 172.21.15.17:0/888605175 shutdown_connections 2024-03-19T06:07:03.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.112+0000 7fb2a8c00640 1 -- 172.21.15.17:0/888605175 wait complete. 2024-03-19T06:07:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.114+0000 7fb2a8c00640 1 Processor -- start 2024-03-19T06:07:03.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.115+0000 7fb2a8c00640 1 -- start start 2024-03-19T06:07:03.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a4070aa0 0x7fb2a40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a40c4fb0 0x7fb2a41e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406f040 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40cc070 con 0x7fb2a4070aa0 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.116+0000 7fb2a8c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406f1c0 con 0x7fb2a40c4fb0 2024-03-19T06:07:03.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.117+0000 7fb29be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.118+0000 7fb29be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51786/0 (socket says 172.21.15.17:51786) 2024-03-19T06:07:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.118+0000 7fb29be00640 1 -- 172.21.15.17:0/1583081353 learned_addr learned my addr 172.21.15.17:0/1583081353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:03.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.119+0000 7fb2a3e00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a40c4fb0 0x7fb2a41e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.121+0000 7fb2a3400640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a4070aa0 0x7fb2a40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.127+0000 7fb29be00640 1 -- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a40c4fb0 msgr2=0x7fb2a41e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.127+0000 7fb29be00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a40c4fb0 0x7fb2a41e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.127+0000 7fb29be00640 1 -- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a4070aa0 msgr2=0x7fb2a40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.127+0000 7fb29be00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a4070aa0 0x7fb2a40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.127+0000 7fb29be00640 1 -- 172.21.15.17:0/1583081353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a41eba70 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.132+0000 7fb29be00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009890 tx=0x7fb28c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.141+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c046070 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.141+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c037c90 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.141+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c02fe60 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.141+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a41ebd50 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.141+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a41ec310 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.143+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404f050 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.179+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb28c049070 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.180+0000 7fb29b400640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 0x7fb28006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.181+0000 7fb2a3400640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 0x7fb28006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.182+0000 7fb2a3400640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 0x7fb28006e110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb294005880 tx=0x7fb294009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:03.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.502+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb28c078d30 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.503+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb28c050080 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.729+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb2a40716d0 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.742+0000 7fb29b400640 1 -- 172.21.15.17:0/1583081353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb28c033030 con 0x7fb2a40c4bd0 2024-03-19T06:07:03.734 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 msgr2=0x7fb28006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 0x7fb28006e110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb294005880 tx=0x7fb294009040 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 msgr2=0x7fb2a4147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009890 tx=0x7fb28c004730 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 shutdown_connections 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb2a40c4fb0 0x7fb2a41e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2a40c4bd0 0x7fb2a4147630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb28006bc50 0x7fb28006e110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 --2- 172.21.15.17:0/1583081353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2a4070aa0 0x7fb2a40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 >> 172.21.15.17:0/1583081353 conn(0x7fb2a406d770 msgr2=0x7fb2a40c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:03.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 shutdown_connections 2024-03-19T06:07:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.746+0000 7fb2a8c00640 1 -- 172.21.15.17:0/1583081353 wait complete. 2024-03-19T06:07:03.756 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:07:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.980+0000 7f7991600640 1 Processor -- start 2024-03-19T06:07:03.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.981+0000 7f7991600640 1 -- start start 2024-03-19T06:07:03.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.982+0000 7f7991600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f798c072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.982+0000 7f7991600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c0cbd80 con 0x7f798c154130 2024-03-19T06:07:03.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.982+0000 7f7991600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f798c0cae90 con 0x7f798c0c9f80 2024-03-19T06:07:03.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.982+0000 7f7991600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0cb330 con 0x7f798c0d0230 2024-03-19T06:07:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.983+0000 7f798aa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f798c154130 0x7f798c15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:57564/0 (socket says 172.21.15.17:57564) 2024-03-19T06:07:03.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.984+0000 7f798aa00640 1 -- 172.21.15.17:0/813643291 learned_addr learned my addr 172.21.15.17:0/813643291 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.986+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753264140 0 0) 0x7f798c0cbd80 con 0x7f798c154130 2024-03-19T06:07:03.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.986+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7970003520 con 0x7f798c154130 2024-03-19T06:07:03.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.992+0000 7f798a000640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f798c072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3952169561 0 0) 0x7f7970003520 con 0x7f798c154130 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 msgr2=0x7f798c072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f798c072360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 >> v1:172.21.15.153:6789/0 conn(0x7f798c0c9f80 legacy=0x7f798c164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0caa40 con 0x7f798c154130 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f7974001670 con 0x7f798c154130 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.993+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 >> v1:172.21.15.17:6789/0 conn(0x7f798c154130 legacy=0x7f798c15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79700039e0 0x7f7970003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f7970004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f79700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0cb330 con 0x7f79700039e0 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797000bba0 con 0x7f7970004d40 2024-03-19T06:07:03.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.994+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797000bda0 con 0x7f798c0d0230 2024-03-19T06:07:03.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:03.998+0000 7f798a000640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f7970004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.000+0000 7f798b400640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f79700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.001+0000 7f798aa00640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79700039e0 0x7f7970003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:03.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.009+0000 7f798b400640 1 -- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 msgr2=0x7f7970004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:03.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.009+0000 7f798b400640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0d0230 0x7f7970004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.009+0000 7f798b400640 1 -- 172.21.15.17:0/813643291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79700039e0 msgr2=0x7f7970003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.009+0000 7f798b400640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79700039e0 0x7f7970003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.009+0000 7f798b400640 1 -- 172.21.15.17:0/813643291 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970003520 con 0x7f7970004d40 2024-03-19T06:07:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.015+0000 7f798b400640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f79700051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7984001750 tx=0x7f7970005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29257af412c11409 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:04.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.026+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984001370 con 0x7f7970004d40 2024-03-19T06:07:04.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.026+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79840052d0 con 0x7f7970004d40 2024-03-19T06:07:04.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.026+0000 7f7989600640 1 -- 172.21.15.17:0/813643291 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7984003830 con 0x7f7970004d40 2024-03-19T06:07:04.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 -- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 msgr2=0x7f79700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:04.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 --2- 172.21.15.17:0/813643291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f79700051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7984001750 tx=0x7f7970005830 comp rx=0 tx=0).stop 2024-03-19T06:07:04.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f798b400640 1 -- 172.21.15.17:0/813643291 reap_dead start 2024-03-19T06:07:04.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 -- 172.21.15.17:0/813643291 shutdown_connections 2024-03-19T06:07:04.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 -- 172.21.15.17:0/813643291 >> 172.21.15.17:0/813643291 conn(0x7f798c066c00 msgr2=0x7f798c0cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:04.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 -- 172.21.15.17:0/813643291 shutdown_connections 2024-03-19T06:07:04.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.027+0000 7f7991600640 1 -- 172.21.15.17:0/813643291 wait complete. 2024-03-19T06:07:04.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.029+0000 7f7991600640 1 Processor -- start 2024-03-19T06:07:04.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.030+0000 7f7991600640 1 -- start start 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0c92d0 0x7f798c1e3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f798c0c78f0 0x7f798c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c15d9d0 con 0x7f798c0c78f0 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0cb8f0 con 0x7f7970004d40 2024-03-19T06:07:04.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.031+0000 7f7991600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798c0ca5e0 con 0x7f798c0c92d0 2024-03-19T06:07:04.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.033+0000 7f798aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:04.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.033+0000 7f798a000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0c92d0 0x7f798c1e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:04.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.033+0000 7f798aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:56390/0 (socket says 172.21.15.17:56390) 2024-03-19T06:07:04.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.033+0000 7f798aa00640 1 -- 172.21.15.17:0/1104344007 learned_addr learned my addr 172.21.15.17:0/1104344007 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:04.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.043+0000 7f798aa00640 1 -- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0c92d0 msgr2=0x7f798c1e3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:04.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.043+0000 7f798aa00640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0c92d0 0x7f798c1e3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.043+0000 7f798aa00640 1 -- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f798c0c78f0 msgr2=0x7f798c0c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:04.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.043+0000 7f798aa00640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f798c0c78f0 0x7f798c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.043+0000 7f798aa00640 1 -- 172.21.15.17:0/1104344007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0c71f0 con 0x7f7970004d40 2024-03-19T06:07:04.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.050+0000 7f798aa00640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f797400e820 tx=0x7f797400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.062+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400c7f0 con 0x7f7970004d40 2024-03-19T06:07:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.062+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974018070 con 0x7f7970004d40 2024-03-19T06:07:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.062+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400cbf0 con 0x7f7970004d40 2024-03-19T06:07:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.062+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c0c82b0 con 0x7f7970004d40 2024-03-19T06:07:04.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.062+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c15d2d0 con 0x7f7970004d40 2024-03-19T06:07:04.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.064+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c069be0 con 0x7f7970004d40 2024-03-19T06:07:04.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.409+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7974026430 con 0x7f7970004d40 2024-03-19T06:07:04.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.411+0000 7f7982a00640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 0x7f796806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:04.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.412+0000 7f798a000640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 0x7f796806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:04.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.413+0000 7f798a000640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 0x7f796806e110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cd040 tx=0x7f797c0097b0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:04.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.417+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7974057430 con 0x7f7970004d40 2024-03-19T06:07:04.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.450+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f798c0c82b0 con 0x7f7970004d40 2024-03-19T06:07:04.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.686+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f798c0c9a30 con 0x7f7970004d40 2024-03-19T06:07:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.700+0000 7f7982a00640 1 -- 172.21.15.17:0/1104344007 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f798c0c71f0 con 0x7f7970004d40 2024-03-19T06:07:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 msgr2=0x7f796806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 0x7f796806e110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f798c0cd040 tx=0x7f797c0097b0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 msgr2=0x7f798c1508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f797400e820 tx=0x7f797400ece0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 shutdown_connections 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f798c0c78f0 0x7f798c0c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f798c0c92d0 0x7f798c1e3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f796806bc50 0x7f796806e110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 --2- 172.21.15.17:0/1104344007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7970004d40 0x7f798c1508a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 >> 172.21.15.17:0/1104344007 conn(0x7f798c066c00 msgr2=0x7f798c072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:04.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 shutdown_connections 2024-03-19T06:07:04.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:04.703+0000 7f7991600640 1 -- 172.21.15.17:0/1104344007 wait complete. 2024-03-19T06:07:04.715 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:07:04.715 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:07:04.760 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.026+0000 7f6e90e00640 1 Processor -- start 2024-03-19T06:07:05.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.026+0000 7f6e90e00640 1 -- start start 2024-03-19T06:07:05.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.028+0000 7f6e90e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6e8c151cb0 0x7f6e8c06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.028+0000 7f6e90e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 0x7f6e8c06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.028+0000 7f6e90e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0c5c50 con 0x7f6e8c15af90 2024-03-19T06:07:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.028+0000 7f6e90e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c5ef0 con 0x7f6e8c151cb0 2024-03-19T06:07:05.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.028+0000 7f6e90e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0718f0 con 0x7f6e8c06cee0 2024-03-19T06:07:05.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.030+0000 7f6e8aa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 0x7f6e8c06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.031+0000 7f6e8be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6e8c15af90 0x7f6e8c15b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:56620/0 (socket says 172.21.15.17:56620) 2024-03-19T06:07:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.031+0000 7f6e8be00640 1 -- 172.21.15.17:0/774991060 learned_addr learned my addr 172.21.15.17:0/774991060 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:05.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.031+0000 7f6e8b400640 1 --2- 172.21.15.17:0/774991060 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c151cb0 0x7f6e8c06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.038+0000 7f6e8aa00640 1 -- 172.21.15.17:0/774991060 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c151cb0 msgr2=0x7f6e8c06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.038+0000 7f6e8aa00640 1 --2- 172.21.15.17:0/774991060 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c151cb0 0x7f6e8c06d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.038+0000 7f6e8aa00640 1 -- 172.21.15.17:0/774991060 >> v1:172.21.15.153:6789/0 conn(0x7f6e8c15af90 legacy=0x7f6e8c15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.038+0000 7f6e8aa00640 1 -- 172.21.15.17:0/774991060 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c071bd0 con 0x7f6e8c06cee0 2024-03-19T06:07:05.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.044+0000 7f6e8aa00640 1 --2- 172.21.15.17:0/774991060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 0x7f6e8c06dd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e780097a0 tx=0x7f6e7802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7d9f8ff8f707850 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.055+0000 7f6e8a000640 1 -- 172.21.15.17:0/774991060 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78034070 con 0x7f6e8c06cee0 2024-03-19T06:07:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.056+0000 7f6e8a000640 1 -- 172.21.15.17:0/774991060 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e78030610 con 0x7f6e8c06cee0 2024-03-19T06:07:05.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.056+0000 7f6e8a000640 1 -- 172.21.15.17:0/774991060 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e780309e0 con 0x7f6e8c06cee0 2024-03-19T06:07:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 -- 172.21.15.17:0/774991060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 msgr2=0x7f6e8c06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 --2- 172.21.15.17:0/774991060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 0x7f6e8c06dd90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6e780097a0 tx=0x7f6e7802b960 comp rx=0 tx=0).stop 2024-03-19T06:07:05.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 -- 172.21.15.17:0/774991060 shutdown_connections 2024-03-19T06:07:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 --2- 172.21.15.17:0/774991060 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c06cee0 0x7f6e8c06dd90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 --2- 172.21.15.17:0/774991060 >> v2:172.21.15.153:3300/0 conn(0x7f6e8c151cb0 0x7f6e8c06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 -- 172.21.15.17:0/774991060 >> 172.21.15.17:0/774991060 conn(0x7f6e8c06e630 msgr2=0x7f6e8c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 -- 172.21.15.17:0/774991060 shutdown_connections 2024-03-19T06:07:05.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.057+0000 7f6e90e00640 1 -- 172.21.15.17:0/774991060 wait complete. 2024-03-19T06:07:05.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.059+0000 7f6e90e00640 1 Processor -- start 2024-03-19T06:07:05.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.060+0000 7f6e90e00640 1 -- start start 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.061+0000 7f6e90e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c06cee0 0x7f6e8c0c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.061+0000 7f6e90e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c151cb0 0x7f6e8c06dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.062+0000 7f6e90e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.062+0000 7f6e90e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c61d0 con 0x7f6e8c15af90 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.062+0000 7f6e90e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c072190 con 0x7f6e8c06cee0 2024-03-19T06:07:05.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.062+0000 7f6e90e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c06f150 con 0x7f6e8c151cb0 2024-03-19T06:07:05.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.063+0000 7f6e8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.063+0000 7f6e8be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51796/0 (socket says 172.21.15.17:51796) 2024-03-19T06:07:05.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.063+0000 7f6e8be00640 1 -- 172.21.15.17:0/1844098460 learned_addr learned my addr 172.21.15.17:0/1844098460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:05.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.064+0000 7f6e8b400640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c06cee0 0x7f6e8c0c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.064+0000 7f6e8aa00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c151cb0 0x7f6e8c06dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.068+0000 7f6e8be00640 1 -- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c151cb0 msgr2=0x7f6e8c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.068+0000 7f6e8be00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c151cb0 0x7f6e8c06dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.068+0000 7f6e8be00640 1 -- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c06cee0 msgr2=0x7f6e8c0c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.068+0000 7f6e8be00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c06cee0 0x7f6e8c0c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.068+0000 7f6e8be00640 1 -- 172.21.15.17:0/1844098460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c152330 con 0x7f6e8c15af90 2024-03-19T06:07:05.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.071+0000 7f6e8be00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400ca80 tx=0x7f6e8400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.075+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84017070 con 0x7f6e8c15af90 2024-03-19T06:07:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.075+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8400ac30 con 0x7f6e8c15af90 2024-03-19T06:07:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.075+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e84012600 con 0x7f6e8c15af90 2024-03-19T06:07:05.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.075+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c152610 con 0x7f6e8c15af90 2024-03-19T06:07:05.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.076+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c152bd0 con 0x7f6e8c15af90 2024-03-19T06:07:05.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.077+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c0686e0 con 0x7f6e8c15af90 2024-03-19T06:07:05.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.100+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6e8401a070 con 0x7f6e8c15af90 2024-03-19T06:07:05.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.101+0000 7f6e83400640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 0x7f6e6c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:05.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.101+0000 7f6e8b400640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 0x7f6e6c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:05.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.103+0000 7f6e8b400640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 0x7f6e6c06e110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009b40 tx=0x7f6e7c009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:05.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.457+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6e84057100 con 0x7f6e8c15af90 2024-03-19T06:07:05.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.458+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f6e8400ae20 con 0x7f6e8c15af90 2024-03-19T06:07:05.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.678+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e8c04f050 con 0x7f6e8c15af90 2024-03-19T06:07:05.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.787+0000 7f6e83400640 1 -- 172.21.15.17:0/1844098460 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f6e84059060 con 0x7f6e8c15af90 2024-03-19T06:07:05.779 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:05.779 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 msgr2=0x7f6e6c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 0x7f6e6c06e110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009b40 tx=0x7f6e7c009190 comp rx=0 tx=0).stop 2024-03-19T06:07:05.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 msgr2=0x7f6e8c1f4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400ca80 tx=0x7f6e8400cf40 comp rx=0 tx=0).stop 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 shutdown_connections 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e8c15af90 0x7f6e8c1f4010 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6e8c151cb0 0x7f6e8c06dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6e6c06bc50 0x7f6e6c06e110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 --2- 172.21.15.17:0/1844098460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8c06cee0 0x7f6e8c0c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.790+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 >> 172.21.15.17:0/1844098460 conn(0x7f6e8c06e630 msgr2=0x7f6e8c15b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.791+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 shutdown_connections 2024-03-19T06:07:05.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:05.791+0000 7f6e90e00640 1 -- 172.21.15.17:0/1844098460 wait complete. 2024-03-19T06:07:05.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:07:05.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:07:06.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.011+0000 7fbd5b200640 1 Processor -- start 2024-03-19T06:07:06.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.012+0000 7fbd5b200640 1 -- start start 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.013+0000 7fbd5b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd5c150390 0x7fbd5c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.013+0000 7fbd5b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c071990 0x7fbd5c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.013+0000 7fbd5b200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5c071050 con 0x7fbd5c0cb720 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.013+0000 7fbd5b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd5c0c4650 con 0x7fbd5c150390 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.013+0000 7fbd5b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c0c3d20 con 0x7fbd5c071990 2024-03-19T06:07:06.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.014+0000 7fbd59e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd5c150390 0x7fbd5c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.015+0000 7fbd59e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd5c150390 0x7fbd5c159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51812/0 (socket says 172.21.15.17:51812) 2024-03-19T06:07:06.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.015+0000 7fbd59e00640 1 -- 172.21.15.17:0/2931450331 learned_addr learned my addr 172.21.15.17:0/2931450331 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:06.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.015+0000 7fbd51400640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c071990 0x7fbd5c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.018+0000 7fbd59e00640 1 -- 172.21.15.17:0/2931450331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c071990 msgr2=0x7fbd5c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.018+0000 7fbd59e00640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c071990 0x7fbd5c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.018+0000 7fbd59e00640 1 -- 172.21.15.17:0/2931450331 >> v1:172.21.15.17:6789/0 conn(0x7fbd5c0cb720 legacy=0x7fbd5c0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.018+0000 7fbd59e00640 1 -- 172.21.15.17:0/2931450331 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c0c4000 con 0x7fbd5c150390 2024-03-19T06:07:06.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.024+0000 7fbd59e00640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c150390 0x7fbd5c159f30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009870 tx=0x7fbd4c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7758f63885b7d87f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:06.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.037+0000 7fbd59400640 1 -- 172.21.15.17:0/2931450331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c02f830 con 0x7fbd5c150390 2024-03-19T06:07:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.037+0000 7fbd59400640 1 -- 172.21.15.17:0/2931450331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c02f9d0 con 0x7fbd5c150390 2024-03-19T06:07:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.037+0000 7fbd59400640 1 -- 172.21.15.17:0/2931450331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c02fda0 con 0x7fbd5c150390 2024-03-19T06:07:06.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 -- 172.21.15.17:0/2931450331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c150390 msgr2=0x7fbd5c159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c150390 0x7fbd5c159f30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c009870 tx=0x7fbd4c02ba10 comp rx=0 tx=0).stop 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 -- 172.21.15.17:0/2931450331 shutdown_connections 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c071990 0x7fbd5c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 --2- 172.21.15.17:0/2931450331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c150390 0x7fbd5c159f30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 -- 172.21.15.17:0/2931450331 >> 172.21.15.17:0/2931450331 conn(0x7fbd5c06d770 msgr2=0x7fbd5c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 -- 172.21.15.17:0/2931450331 shutdown_connections 2024-03-19T06:07:06.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.038+0000 7fbd5b200640 1 -- 172.21.15.17:0/2931450331 wait complete. 2024-03-19T06:07:06.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.040+0000 7fbd5b200640 1 Processor -- start 2024-03-19T06:07:06.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.040+0000 7fbd5b200640 1 -- start start 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c0cb720 0x7fbd5c1f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd5c150390 0x7fbd5c155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c070db0 con 0x7fbd5c071990 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c070c30 con 0x7fbd5c150390 2024-03-19T06:07:06.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.041+0000 7fbd5b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5c0c51f0 con 0x7fbd5c0cb720 2024-03-19T06:07:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.042+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.042+0000 7fbd59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51820/0 (socket says 172.21.15.17:51820) 2024-03-19T06:07:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.042+0000 7fbd59e00640 1 -- 172.21.15.17:0/4293072622 learned_addr learned my addr 172.21.15.17:0/4293072622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:06.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.043+0000 7fbd5a800640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd5c150390 0x7fbd5c155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.043+0000 7fbd51400640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c0cb720 0x7fbd5c1f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.047+0000 7fbd59e00640 1 -- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c0cb720 msgr2=0x7fbd5c1f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.047+0000 7fbd59e00640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c0cb720 0x7fbd5c1f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.047+0000 7fbd59e00640 1 -- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd5c150390 msgr2=0x7fbd5c155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.047+0000 7fbd59e00640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd5c150390 0x7fbd5c155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.047+0000 7fbd59e00640 1 -- 172.21.15.17:0/4293072622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5c14c120 con 0x7fbd5c071990 2024-03-19T06:07:06.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.050+0000 7fbd59e00640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c000c00 tx=0x7fbd4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.054+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c037c40 con 0x7fbd5c071990 2024-03-19T06:07:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.054+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c047070 con 0x7fbd5c071990 2024-03-19T06:07:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.054+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c1f3aa0 con 0x7fbd5c071990 2024-03-19T06:07:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.054+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c042480 con 0x7fbd5c071990 2024-03-19T06:07:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.055+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd5c159f20 con 0x7fbd5c071990 2024-03-19T06:07:06.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.056+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5c0c3130 con 0x7fbd5c071990 2024-03-19T06:07:06.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.082+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbd4c040050 con 0x7fbd5c071990 2024-03-19T06:07:06.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.084+0000 7fbd52a00640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 0x7fbd3806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.084+0000 7fbd51400640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 0x7fbd3806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.086+0000 7fbd51400640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 0x7fbd3806e0e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0c8b20 tx=0x7fbd44009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:06.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.088+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbd4c07a480 con 0x7fbd5c071990 2024-03-19T06:07:06.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.403+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fbd4c033030 con 0x7fbd5c071990 2024-03-19T06:07:06.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.619+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd5c04f050 con 0x7fbd5c071990 2024-03-19T06:07:06.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.637+0000 7fbd52a00640 1 -- 172.21.15.17:0/4293072622 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd4c07c3e0 con 0x7fbd5c071990 2024-03-19T06:07:06.628 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:07:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 msgr2=0x7fbd3806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 0x7fbd3806e0e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0c8b20 tx=0x7fbd44009190 comp rx=0 tx=0).stop 2024-03-19T06:07:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 msgr2=0x7fbd5c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c000c00 tx=0x7fbd4c0046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 shutdown_connections 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbd3806bc20 0x7fbd3806e0e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd5c150390 0x7fbd5c155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbd5c0cb720 0x7fbd5c1f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 --2- 172.21.15.17:0/4293072622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd5c071990 0x7fbd5c154ab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.640+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 >> 172.21.15.17:0/4293072622 conn(0x7fbd5c06d770 msgr2=0x7fbd5c14a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.641+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 shutdown_connections 2024-03-19T06:07:06.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.641+0000 7fbd5b200640 1 -- 172.21.15.17:0/4293072622 wait complete. 2024-03-19T06:07:06.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:07:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.879+0000 7fc952400640 1 Processor -- start 2024-03-19T06:07:06.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.879+0000 7fc952400640 1 -- start start 2024-03-19T06:07:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.881+0000 7fc952400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc94c151c20 0x7fc94c0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.881+0000 7fc952400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc94c072e40 0x7fc94c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.881+0000 7fc952400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c06f8b0 con 0x7fc94c06b4a0 2024-03-19T06:07:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.881+0000 7fc952400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06fb70 con 0x7fc94c151c20 2024-03-19T06:07:06.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.881+0000 7fc952400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c06fe50 con 0x7fc94c072e40 2024-03-19T06:07:06.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.883+0000 7fc94be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc94c072e40 0x7fc94c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.884+0000 7fc94be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc94c072e40 0x7fc94c0c6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:56400/0 (socket says 172.21.15.17:56400) 2024-03-19T06:07:06.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.884+0000 7fc94be00640 1 -- 172.21.15.17:0/2980964510 learned_addr learned my addr 172.21.15.17:0/2980964510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:06.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.890+0000 7fc94be00640 1 -- 172.21.15.17:0/2980964510 >> v2:172.21.15.17:3300/0 conn(0x7fc94c151c20 msgr2=0x7fc94c0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.890+0000 7fc94be00640 1 --2- 172.21.15.17:0/2980964510 >> v2:172.21.15.17:3300/0 conn(0x7fc94c151c20 0x7fc94c0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.890+0000 7fc94be00640 1 -- 172.21.15.17:0/2980964510 >> v1:172.21.15.17:6789/0 conn(0x7fc94c06b4a0 legacy=0x7fc94c072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:06.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.890+0000 7fc94be00640 1 -- 172.21.15.17:0/2980964510 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c070130 con 0x7fc94c072e40 2024-03-19T06:07:06.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.897+0000 7fc94be00640 1 --2- 172.21.15.17:0/2980964510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c072e40 0x7fc94c0c6020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06b8e0 tx=0x7fc94402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3bb2d7b7c64c1df server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:06.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.908+0000 7fc94a000640 1 -- 172.21.15.17:0/2980964510 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94402cb20 con 0x7fc94c072e40 2024-03-19T06:07:06.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.908+0000 7fc94a000640 1 -- 172.21.15.17:0/2980964510 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94402ccc0 con 0x7fc94c072e40 2024-03-19T06:07:06.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.908+0000 7fc94a000640 1 -- 172.21.15.17:0/2980964510 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc944034610 con 0x7fc94c072e40 2024-03-19T06:07:06.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.909+0000 7fc952400640 1 -- 172.21.15.17:0/2980964510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c072e40 msgr2=0x7fc94c0c6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.909+0000 7fc952400640 1 --2- 172.21.15.17:0/2980964510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c072e40 0x7fc94c0c6020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc94c06b8e0 tx=0x7fc94402bf80 comp rx=0 tx=0).stop 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 -- 172.21.15.17:0/2980964510 shutdown_connections 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 --2- 172.21.15.17:0/2980964510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c072e40 0x7fc94c0c6020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 --2- 172.21.15.17:0/2980964510 >> v2:172.21.15.17:3300/0 conn(0x7fc94c151c20 0x7fc94c0c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 -- 172.21.15.17:0/2980964510 >> 172.21.15.17:0/2980964510 conn(0x7fc94c067430 msgr2=0x7fc94c06bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 -- 172.21.15.17:0/2980964510 shutdown_connections 2024-03-19T06:07:06.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.910+0000 7fc952400640 1 -- 172.21.15.17:0/2980964510 wait complete. 2024-03-19T06:07:06.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.913+0000 7fc952400640 1 Processor -- start 2024-03-19T06:07:06.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.913+0000 7fc952400640 1 -- start start 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc94c072e40 0x7fc94c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c151c20 0x7fc94c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c157f50 con 0x7fc94c072e40 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c157dd0 con 0x7fc94c151c20 2024-03-19T06:07:06.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.914+0000 7fc952400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c1580d0 con 0x7fc94c06b4a0 2024-03-19T06:07:06.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.918+0000 7fc94b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.923+0000 7fc94be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c151c20 0x7fc94c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.923+0000 7fc94b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:37170/0 (socket says 172.21.15.17:37170) 2024-03-19T06:07:06.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.923+0000 7fc94b400640 1 -- 172.21.15.17:0/3691204006 learned_addr learned my addr 172.21.15.17:0/3691204006 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:06.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.925+0000 7fc94aa00640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc94c072e40 0x7fc94c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.942+0000 7fc94b400640 1 -- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c151c20 msgr2=0x7fc94c1479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.942+0000 7fc94b400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c151c20 0x7fc94c1479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.942+0000 7fc94b400640 1 -- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc94c072e40 msgr2=0x7fc94c14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.942+0000 7fc94b400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc94c072e40 0x7fc94c14d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:06.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.942+0000 7fc94b400640 1 -- 172.21.15.17:0/3691204006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c15b900 con 0x7fc94c06b4a0 2024-03-19T06:07:06.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:06.950+0000 7fc94b400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00b440 tx=0x7fc93c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:07.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.053+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c015020 con 0x7fc94c06b4a0 2024-03-19T06:07:07.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.053+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c011890 con 0x7fc94c06b4a0 2024-03-19T06:07:07.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.053+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011c80 con 0x7fc94c06b4a0 2024-03-19T06:07:07.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.053+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c15bbe0 con 0x7fc94c06b4a0 2024-03-19T06:07:07.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.054+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c14bec0 con 0x7fc94c06b4a0 2024-03-19T06:07:07.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.055+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c14e870 con 0x7fc94c06b4a0 2024-03-19T06:07:07.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.115+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc93c018020 con 0x7fc94c06b4a0 2024-03-19T06:07:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.117+0000 7fc943400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 0x7fc92c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:07.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.118+0000 7fc94aa00640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 0x7fc92c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:07.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.119+0000 7fc94aa00640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 0x7fc92c06e110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc94c158e20 tx=0x7fc938009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.122+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc93c0575d0 con 0x7fc94c06b4a0 2024-03-19T06:07:07.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.452+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc93c01f020 con 0x7fc94c06b4a0 2024-03-19T06:07:07.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.673+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc94c067d60 con 0x7fc94c06b4a0 2024-03-19T06:07:07.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.714+0000 7fc943400640 1 -- 172.21.15.17:0/3691204006 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc93c00d040 con 0x7fc94c06b4a0 2024-03-19T06:07:07.705 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.716+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 msgr2=0x7fc92c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.716+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 0x7fc92c06e110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc94c158e20 tx=0x7fc938009040 comp rx=0 tx=0).stop 2024-03-19T06:07:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 msgr2=0x7fc94c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:07.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00b440 tx=0x7fc93c00b900 comp rx=0 tx=0).stop 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 shutdown_connections 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc92c06bc50 0x7fc92c06e110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc94c151c20 0x7fc94c1479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc94c072e40 0x7fc94c14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 --2- 172.21.15.17:0/3691204006 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc94c06b4a0 0x7fc94c14cf80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 >> 172.21.15.17:0/3691204006 conn(0x7fc94c067430 msgr2=0x7fc94c150640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 shutdown_connections 2024-03-19T06:07:07.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.717+0000 7fc952400640 1 -- 172.21.15.17:0/3691204006 wait complete. 2024-03-19T06:07:07.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:07:07.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.956+0000 7f3d38e00640 1 Processor -- start 2024-03-19T06:07:07.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.957+0000 7f3d38e00640 1 -- start start 2024-03-19T06:07:07.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.960+0000 7f3d38e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d340c6b60 0x7f3d3415aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.960+0000 7f3d38e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340c3800 con 0x7f3d340c5520 2024-03-19T06:07:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.960+0000 7f3d38e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d340c3ae0 con 0x7f3d341569b0 2024-03-19T06:07:07.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:07.960+0000 7f3d38e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3415a5f0 con 0x7f3d340c6b60 2024-03-19T06:07:08.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.035+0000 7f3d32a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d340c6b60 0x7f3d3415aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:08.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.042+0000 7f3d32a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3d340c6b60 0x7f3d3415aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51850/0 (socket says 172.21.15.17:51850) 2024-03-19T06:07:08.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.042+0000 7f3d32a00640 1 -- 172.21.15.17:0/2967455553 learned_addr learned my addr 172.21.15.17:0/2967455553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:08.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.050+0000 7f3d32a00640 1 -- 172.21.15.17:0/2967455553 >> v1:172.21.15.153:6789/0 conn(0x7f3d341569b0 legacy=0x7f3d34161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.050+0000 7f3d32a00640 1 -- 172.21.15.17:0/2967455553 >> v1:172.21.15.17:6789/0 conn(0x7f3d340c5520 legacy=0x7f3d34072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.050+0000 7f3d32a00640 1 -- 172.21.15.17:0/2967455553 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340c3dc0 con 0x7f3d340c6b60 2024-03-19T06:07:08.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.059+0000 7f3d32a00640 1 --2- 172.21.15.17:0/2967455553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d340c6b60 0x7f3d3415aa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000bb10 tx=0x7f3d2002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4be3165724eb34 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.088+0000 7f3d32000640 1 -- 172.21.15.17:0/2967455553 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2003b070 con 0x7f3d340c6b60 2024-03-19T06:07:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.088+0000 7f3d32000640 1 -- 172.21.15.17:0/2967455553 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20036440 con 0x7f3d340c6b60 2024-03-19T06:07:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.088+0000 7f3d32000640 1 -- 172.21.15.17:0/2967455553 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20036810 con 0x7f3d340c6b60 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 -- 172.21.15.17:0/2967455553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d340c6b60 msgr2=0x7f3d3415aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 --2- 172.21.15.17:0/2967455553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d340c6b60 0x7f3d3415aa80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3d2000bb10 tx=0x7f3d2002e0e0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 -- 172.21.15.17:0/2967455553 shutdown_connections 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 --2- 172.21.15.17:0/2967455553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d340c6b60 0x7f3d3415aa80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 -- 172.21.15.17:0/2967455553 >> 172.21.15.17:0/2967455553 conn(0x7f3d340cc260 msgr2=0x7f3d340cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 -- 172.21.15.17:0/2967455553 shutdown_connections 2024-03-19T06:07:08.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.090+0000 7f3d38e00640 1 -- 172.21.15.17:0/2967455553 wait complete. 2024-03-19T06:07:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.094+0000 7f3d38e00640 1 Processor -- start 2024-03-19T06:07:08.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.095+0000 7f3d38e00640 1 -- start start 2024-03-19T06:07:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 0x7f3d34159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 0x7f3d3406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d341569b0 0x7f3d3406b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3415a280 con 0x7f3d341569b0 2024-03-19T06:07:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34156e60 con 0x7f3d340c5520 2024-03-19T06:07:08.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.097+0000 7f3d38e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34150ff0 con 0x7f3d340c6b60 2024-03-19T06:07:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.099+0000 7f3d33400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 0x7f3d34159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:08.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.099+0000 7f3d32a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 0x7f3d3406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.100+0000 7f3d33400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 0x7f3d34159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:56408/0 (socket says 172.21.15.17:56408) 2024-03-19T06:07:08.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.100+0000 7f3d33400640 1 -- 172.21.15.17:0/106679328 learned_addr learned my addr 172.21.15.17:0/106679328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.110+0000 7f3d32a00640 1 -- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 msgr2=0x7f3d34159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.110+0000 7f3d32a00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 0x7f3d34159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.110+0000 7f3d32a00640 1 -- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d341569b0 msgr2=0x7f3d3406b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:08.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.110+0000 7f3d32a00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d341569b0 0x7f3d3406b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.111+0000 7f3d32a00640 1 -- 172.21.15.17:0/106679328 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34157b70 con 0x7f3d340c6b60 2024-03-19T06:07:08.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.118+0000 7f3d32a00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 0x7f3d3406ac30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d20035000 tx=0x7f3d200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.129+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20046070 con 0x7f3d340c6b60 2024-03-19T06:07:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.130+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20034930 con 0x7f3d340c6b60 2024-03-19T06:07:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.130+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2003b040 con 0x7f3d340c6b60 2024-03-19T06:07:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.130+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d341f0790 con 0x7f3d340c6b60 2024-03-19T06:07:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.130+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d341e5840 con 0x7f3d340c6b60 2024-03-19T06:07:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.132+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3404f050 con 0x7f3d340c6b60 2024-03-19T06:07:08.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.483+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3d20049070 con 0x7f3d340c6b60 2024-03-19T06:07:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.485+0000 7f3d2b400640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 0x7f3d1406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.486+0000 7f3d33400640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 0x7f3d1406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:08.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.488+0000 7f3d33400640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 0x7f3d1406e110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d240018b0 tx=0x7f3d24009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:08.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.488+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3d20079150 con 0x7f3d340c6b60 2024-03-19T06:07:08.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.517+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f3d20051080 con 0x7f3d340c6b60 2024-03-19T06:07:08.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.735+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d34072bb0 con 0x7f3d340c6b60 2024-03-19T06:07:08.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.753+0000 7f3d2b400640 1 -- 172.21.15.17:0/106679328 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d2007b0b0 con 0x7f3d340c6b60 2024-03-19T06:07:08.743 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:07:08.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 msgr2=0x7f3d1406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:08.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 0x7f3d1406e110 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3d240018b0 tx=0x7f3d24009040 comp rx=0 tx=0).stop 2024-03-19T06:07:08.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 msgr2=0x7f3d3406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 0x7f3d3406ac30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d20035000 tx=0x7f3d200046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 shutdown_connections 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d341569b0 0x7f3d3406b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3d340c6b60 0x7f3d3406ac30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3d1406bc50 0x7f3d1406e110 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 --2- 172.21.15.17:0/106679328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d340c5520 0x7f3d34159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.755+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 >> 172.21.15.17:0/106679328 conn(0x7f3d340cc260 msgr2=0x7f3d3414fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.756+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 shutdown_connections 2024-03-19T06:07:08.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:08.756+0000 7f3d38e00640 1 -- 172.21.15.17:0/106679328 wait complete. 2024-03-19T06:07:08.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:07:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.001+0000 7f24fe800640 1 Processor -- start 2024-03-19T06:07:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.001+0000 7f24fe800640 1 -- start start 2024-03-19T06:07:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.003+0000 7f24fe800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f24f8154220 0x7f24f80ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.003+0000 7f24fe800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.003+0000 7f24fe800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f815a130 con 0x7f24f815de20 2024-03-19T06:07:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.003+0000 7f24fe800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f80ca330 con 0x7f24f8154220 2024-03-19T06:07:08.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.003+0000 7f24fe800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f815a410 con 0x7f24f80cb240 2024-03-19T06:07:08.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.008+0000 7f24f7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:08.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.009+0000 7f24f7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:37192/0 (socket says 172.21.15.17:37192) 2024-03-19T06:07:08.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.009+0000 7f24f7e00640 1 -- 172.21.15.17:0/3181027709 learned_addr learned my addr 172.21.15.17:0/3181027709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.015+0000 7f24f7e00640 1 -- 172.21.15.17:0/3181027709 >> v2:172.21.15.153:3300/0 conn(0x7f24f8154220 msgr2=0x7f24f80ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.015+0000 7f24f7e00640 1 --2- 172.21.15.17:0/3181027709 >> v2:172.21.15.153:3300/0 conn(0x7f24f8154220 0x7f24f80ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.015+0000 7f24f7e00640 1 -- 172.21.15.17:0/3181027709 >> v1:172.21.15.17:6789/0 conn(0x7f24f815de20 legacy=0x7f24f80cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.016+0000 7f24f7e00640 1 -- 172.21.15.17:0/3181027709 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f815a6f0 con 0x7f24f80cb240 2024-03-19T06:07:09.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.118+0000 7f24f7e00640 1 --2- 172.21.15.17:0/3181027709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009e50 tx=0x7f24f002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da03f5028b888a57 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.136+0000 7f24f6000640 1 -- 172.21.15.17:0/3181027709 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f002cb00 con 0x7f24f80cb240 2024-03-19T06:07:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.136+0000 7f24f6000640 1 -- 172.21.15.17:0/3181027709 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f002cca0 con 0x7f24f80cb240 2024-03-19T06:07:09.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.136+0000 7f24f6000640 1 -- 172.21.15.17:0/3181027709 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0034610 con 0x7f24f80cb240 2024-03-19T06:07:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.137+0000 7f24fe800640 1 -- 172.21.15.17:0/3181027709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 msgr2=0x7f24f80cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:09.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.137+0000 7f24fe800640 1 --2- 172.21.15.17:0/3181027709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24f0009e50 tx=0x7f24f002bf60 comp rx=0 tx=0).stop 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 -- 172.21.15.17:0/3181027709 shutdown_connections 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 --2- 172.21.15.17:0/3181027709 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f80cb240 0x7f24f80cb650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 --2- 172.21.15.17:0/3181027709 >> v2:172.21.15.153:3300/0 conn(0x7f24f8154220 0x7f24f80ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 -- 172.21.15.17:0/3181027709 >> 172.21.15.17:0/3181027709 conn(0x7f24f806c170 msgr2=0x7f24f806c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 -- 172.21.15.17:0/3181027709 shutdown_connections 2024-03-19T06:07:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.138+0000 7f24fe800640 1 -- 172.21.15.17:0/3181027709 wait complete. 2024-03-19T06:07:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.142+0000 7f24fe800640 1 Processor -- start 2024-03-19T06:07:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.142+0000 7f24fe800640 1 -- start start 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 0x7f24f81e5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f815de20 0x7f24f8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80cad20 con 0x7f24f8154220 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f815acb0 con 0x7f24f80cb240 2024-03-19T06:07:09.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.145+0000 7f24fe800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f80cbb90 con 0x7f24f815de20 2024-03-19T06:07:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.146+0000 7f24f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.146+0000 7f24f7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 0x7f24f81e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:09.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.147+0000 7f24f7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f815de20 0x7f24f8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.147+0000 7f24f6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51878/0 (socket says 172.21.15.17:51878) 2024-03-19T06:07:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.147+0000 7f24f6a00640 1 -- 172.21.15.17:0/1366215278 learned_addr learned my addr 172.21.15.17:0/1366215278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:09.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.147+0000 7f24f7400640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 0x7f24f81e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:56428/0 (socket says 172.21.15.17:56428) 2024-03-19T06:07:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.156+0000 7f24f6a00640 1 -- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f815de20 msgr2=0x7f24f8158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.156+0000 7f24f6a00640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f815de20 0x7f24f8158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.156+0000 7f24f6a00640 1 -- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 msgr2=0x7f24f81e5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.156+0000 7f24f6a00640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 0x7f24f81e5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.156+0000 7f24f6a00640 1 -- 172.21.15.17:0/1366215278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f81e5e30 con 0x7f24f8154220 2024-03-19T06:07:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.162+0000 7f24f6a00640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e400b3e0 tx=0x7f24e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.171+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4015020 con 0x7f24f8154220 2024-03-19T06:07:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.171+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e4011850 con 0x7f24f8154220 2024-03-19T06:07:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.171+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e4011c40 con 0x7f24f8154220 2024-03-19T06:07:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.171+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f815d990 con 0x7f24f8154220 2024-03-19T06:07:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.172+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f81e30b0 con 0x7f24f8154220 2024-03-19T06:07:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.174+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f8066b30 con 0x7f24f8154220 2024-03-19T06:07:09.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.537+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f24e4018020 con 0x7f24f8154220 2024-03-19T06:07:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.539+0000 7f24ef400640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 0x7f24d806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:09.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.539+0000 7f24f7400640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 0x7f24d806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:09.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.541+0000 7f24f7400640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 0x7f24d806e0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098e0 tx=0x7f24e8009060 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:09.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.603+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f24e4011de0 con 0x7f24f8154220 2024-03-19T06:07:09.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.604+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f24e401f020 con 0x7f24f8154220 2024-03-19T06:07:09.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.835+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24f8067d60 con 0x7f24f8154220 2024-03-19T06:07:09.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.842+0000 7f24ef400640 1 -- 172.21.15.17:0/1366215278 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24e4059350 con 0x7f24f8154220 2024-03-19T06:07:09.833 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 msgr2=0x7f24d806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 0x7f24d806e0e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098e0 tx=0x7f24e8009060 comp rx=0 tx=0).stop 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 msgr2=0x7f24f80c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e400b3e0 tx=0x7f24e400b8a0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 shutdown_connections 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f24f815de20 0x7f24f8158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f8154220 0x7f24f80c7b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f24d806bc20 0x7f24d806e0e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 --2- 172.21.15.17:0/1366215278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24f80cb240 0x7f24f81e5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:09.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 >> 172.21.15.17:0/1366215278 conn(0x7f24f806c170 msgr2=0x7f24f80b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:09.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 shutdown_connections 2024-03-19T06:07:09.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:09.845+0000 7f24fe800640 1 -- 172.21.15.17:0/1366215278 wait complete. 2024-03-19T06:07:09.859 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:07:10.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.084+0000 7f2923c00640 1 Processor -- start 2024-03-19T06:07:10.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.085+0000 7f2923c00640 1 -- start start 2024-03-19T06:07:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.086+0000 7f2923c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f291c15e070 0x7f291c0b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.086+0000 7f2923c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f291c0c7fe0 0x7f291c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.086+0000 7f2923c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c0c9c80 con 0x7f291c0c9270 2024-03-19T06:07:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.086+0000 7f2923c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c15d4d0 con 0x7f291c0c7fe0 2024-03-19T06:07:10.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.086+0000 7f2923c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c06c830 con 0x7f291c15e070 2024-03-19T06:07:10.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.088+0000 7f2921200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f291c15e070 0x7f291c0b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.089+0000 7f2921200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f291c15e070 0x7f291c0b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:43394/0 (socket says 172.21.15.17:43394) 2024-03-19T06:07:10.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.089+0000 7f2921200640 1 -- 172.21.15.17:0/2290190830 learned_addr learned my addr 172.21.15.17:0/2290190830 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.098+0000 7f2921200640 1 -- 172.21.15.17:0/2290190830 >> v2:172.21.15.17:3300/0 conn(0x7f291c0c7fe0 msgr2=0x7f291c0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.098+0000 7f2921200640 1 --2- 172.21.15.17:0/2290190830 >> v2:172.21.15.17:3300/0 conn(0x7f291c0c7fe0 0x7f291c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.098+0000 7f2921200640 1 -- 172.21.15.17:0/2290190830 >> v1:172.21.15.17:6789/0 conn(0x7f291c0c9270 legacy=0x7f291c06ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:10.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.098+0000 7f2921200640 1 -- 172.21.15.17:0/2290190830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c06bf90 con 0x7f291c15e070 2024-03-19T06:07:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.117+0000 7f2921200640 1 --2- 172.21.15.17:0/2290190830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c15e070 0x7f291c0b0000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f291c06f4e0 tx=0x7f291002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df3401f1220a99c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:10.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.236+0000 7f291b400640 1 -- 172.21.15.17:0/2290190830 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291002e070 con 0x7f291c15e070 2024-03-19T06:07:10.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.236+0000 7f291b400640 1 -- 172.21.15.17:0/2290190830 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910037070 con 0x7f291c15e070 2024-03-19T06:07:10.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.236+0000 7f291b400640 1 -- 172.21.15.17:0/2290190830 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910031a00 con 0x7f291c15e070 2024-03-19T06:07:10.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.237+0000 7f2923c00640 1 -- 172.21.15.17:0/2290190830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c15e070 msgr2=0x7f291c0b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:10.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 --2- 172.21.15.17:0/2290190830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c15e070 0x7f291c0b0000 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f291c06f4e0 tx=0x7f291002b880 comp rx=0 tx=0).stop 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 -- 172.21.15.17:0/2290190830 shutdown_connections 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 --2- 172.21.15.17:0/2290190830 >> v2:172.21.15.17:3300/0 conn(0x7f291c0c7fe0 0x7f291c0c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 --2- 172.21.15.17:0/2290190830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c15e070 0x7f291c0b0000 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 -- 172.21.15.17:0/2290190830 >> 172.21.15.17:0/2290190830 conn(0x7f291c06ae10 msgr2=0x7f291c066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 -- 172.21.15.17:0/2290190830 shutdown_connections 2024-03-19T06:07:10.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.238+0000 7f2923c00640 1 -- 172.21.15.17:0/2290190830 wait complete. 2024-03-19T06:07:10.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.242+0000 7f2923c00640 1 Processor -- start 2024-03-19T06:07:10.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.242+0000 7f2923c00640 1 -- start start 2024-03-19T06:07:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291c0c7fe0 0x7f291c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 0x7f291c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 0x7f291c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c0c47b0 con 0x7f291c15e070 2024-03-19T06:07:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c06bd40 con 0x7f291c0c9270 2024-03-19T06:07:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.244+0000 7f2923c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c06c550 con 0x7f291c0c7fe0 2024-03-19T06:07:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.246+0000 7f2921c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 0x7f291c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.247+0000 7f2921c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 0x7f291c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46792/0 (socket says 172.21.15.17:46792) 2024-03-19T06:07:10.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.247+0000 7f2921c00640 1 -- 172.21.15.17:0/932453190 learned_addr learned my addr 172.21.15.17:0/932453190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:10.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.250+0000 7f291be00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 0x7f291c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.258+0000 7f2921200640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291c0c7fe0 0x7f291c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:10.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.271+0000 7f291be00640 1 -- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291c0c7fe0 msgr2=0x7f291c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:10.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.271+0000 7f291be00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291c0c7fe0 0x7f291c1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:10.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.271+0000 7f291be00640 1 -- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 msgr2=0x7f291c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:10.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.271+0000 7f291be00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 0x7f291c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:10.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.271+0000 7f291be00640 1 -- 172.21.15.17:0/932453190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c150490 con 0x7f291c0c9270 2024-03-19T06:07:10.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.366+0000 7f291be00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 0x7f291c154570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f290800b410 tx=0x7f290800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.380+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908015020 con 0x7f291c0c9270 2024-03-19T06:07:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.381+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2908011850 con 0x7f291c0c9270 2024-03-19T06:07:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.381+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908011c40 con 0x7f291c0c9270 2024-03-19T06:07:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.381+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c1e5ee0 con 0x7f291c0c9270 2024-03-19T06:07:10.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.381+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c1501b0 con 0x7f291c0c9270 2024-03-19T06:07:10.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.383+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c0c7cd0 con 0x7f291c0c9270 2024-03-19T06:07:10.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.721+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2908018020 con 0x7f291c0c9270 2024-03-19T06:07:10.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.723+0000 7f2918c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 0x7f28fc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:10.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.724+0000 7f2921200640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 0x7f28fc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:10.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.726+0000 7f2921200640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 0x7f28fc06e110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2910036000 tx=0x7f291003d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:10.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.727+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2908011de0 con 0x7f291c0c9270 2024-03-19T06:07:10.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.756+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f291c0c7cd0 con 0x7f291c0c9270 2024-03-19T06:07:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:10.988+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f291c067d60 con 0x7f291c0c9270 2024-03-19T06:07:10.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.005+0000 7f2918c00640 1 -- 172.21.15.17:0/932453190 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f290801f020 con 0x7f291c0c9270 2024-03-19T06:07:10.997 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 msgr2=0x7f28fc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 0x7f28fc06e110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2910036000 tx=0x7f291003d040 comp rx=0 tx=0).stop 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 msgr2=0x7f291c154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 0x7f291c154570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f290800b410 tx=0x7f290800b8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 shutdown_connections 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f291c15e070 0x7f291c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f28fc06bc50 0x7f28fc06e110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:11.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c0c9270 0x7f291c154570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:11.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 --2- 172.21.15.17:0/932453190 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f291c0c7fe0 0x7f291c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:11.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 >> 172.21.15.17:0/932453190 conn(0x7f291c06ae10 msgr2=0x7f291c0c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:11.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 shutdown_connections 2024-03-19T06:07:11.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:11.008+0000 7f2923c00640 1 -- 172.21.15.17:0/932453190 wait complete. 2024-03-19T06:07:11.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-03-19T06:07:11.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:07:11.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-19T06:07:11.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi017.stderr:ceph-fuse[42418]: fuse finished with error 0 and tester_r 0 2024-03-19T06:07:11.117 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:07:17.219 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:07:17.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:07:17.220 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-19T06:07:17.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.531+0000 7fc9cbe00640 1 Processor -- start 2024-03-19T06:07:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.531+0000 7fc9cbe00640 1 -- start start 2024-03-19T06:07:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.532+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc06d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.532+0000 7fc9cbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9cc06cee0 0x7fc9cc06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.532+0000 7fc9cbe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0c5c50 con 0x7fc9cc15af90 2024-03-19T06:07:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.532+0000 7fc9cbe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0c5ef0 con 0x7fc9cc06cee0 2024-03-19T06:07:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.532+0000 7fc9cbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0718f0 con 0x7fc9cc151cb0 2024-03-19T06:07:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.534+0000 7fc9ca000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc9cc06cee0 0x7fc9cc06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.534+0000 7fc9cb400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc9cc15af90 0x7fc9cc15b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:54788/0 (socket says 172.21.15.17:54788) 2024-03-19T06:07:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.534+0000 7fc9cb400640 1 -- 172.21.15.17:0/1001504309 learned_addr learned my addr 172.21.15.17:0/1001504309 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.535+0000 7fc9caa00640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc06d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.537+0000 7fc9ca000640 1 -- 172.21.15.17:0/1001504309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 msgr2=0x7fc9cc06d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.537+0000 7fc9ca000640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc06d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:17.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.537+0000 7fc9ca000640 1 -- 172.21.15.17:0/1001504309 >> v1:172.21.15.153:6789/0 conn(0x7fc9cc15af90 legacy=0x7fc9cc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:17.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.537+0000 7fc9ca000640 1 -- 172.21.15.17:0/1001504309 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc071bd0 con 0x7fc9cc06cee0 2024-03-19T06:07:17.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.540+0000 7fc9ca000640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc06dd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80097a0 tx=0x7fc9b802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a88707a7d00965f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:17.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.546+0000 7fc9c9600640 1 -- 172.21.15.17:0/1001504309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8034070 con 0x7fc9cc06cee0 2024-03-19T06:07:17.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.546+0000 7fc9c9600640 1 -- 172.21.15.17:0/1001504309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8030610 con 0x7fc9cc06cee0 2024-03-19T06:07:17.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.546+0000 7fc9c9600640 1 -- 172.21.15.17:0/1001504309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80309e0 con 0x7fc9cc06cee0 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1001504309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc06cee0 msgr2=0x7fc9cc06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc06dd90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80097a0 tx=0x7fc9b802b960 comp rx=0 tx=0).stop 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1001504309 shutdown_connections 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc06dd90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1001504309 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc06d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.547+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1001504309 >> 172.21.15.17:0/1001504309 conn(0x7fc9cc06e630 msgr2=0x7fc9cc06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.548+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1001504309 shutdown_connections 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.548+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1001504309 wait complete. 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.550+0000 7fc9cbe00640 1 Processor -- start 2024-03-19T06:07:17.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.550+0000 7fc9cbe00640 1 -- start start 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0c61d0 con 0x7fc9cc15af90 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc072190 con 0x7fc9cc06cee0 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.551+0000 7fc9cbe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc06f150 con 0x7fc9cc151cb0 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.552+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.553+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46808/0 (socket says 172.21.15.17:46808) 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.553+0000 7fc9cb400640 1 -- 172.21.15.17:0/1176879425 learned_addr learned my addr 172.21.15.17:0/1176879425 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.554+0000 7fc9ca000640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.556+0000 7fc9caa00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9cb400640 1 -- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 msgr2=0x7fc9cc158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9cb400640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:17.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9cb400640 1 -- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 msgr2=0x7fc9cc0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9cb400640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9cb400640 1 -- 172.21.15.17:0/1176879425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc1f4150 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.557+0000 7fc9caa00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.559+0000 7fc9cb400640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400ca80 tx=0x7fc9c400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.564+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4017070 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.564+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c400ac30 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.564+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4012600 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.564+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc1f4410 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.564+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc1f06c0 con 0x7fc9cc15af90 2024-03-19T06:07:17.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.566+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc0686e0 con 0x7fc9cc15af90 2024-03-19T06:07:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.879+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc9c401a070 con 0x7fc9cc15af90 2024-03-19T06:07:17.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.881+0000 7fc9c2a00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 0x7fc9ac06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.882+0000 7fc9caa00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 0x7fc9ac06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.883+0000 7fc9caa00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 0x7fc9ac06e0e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc008890 tx=0x7fc9bc008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:17.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.917+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc9c4057120 con 0x7fc9cc15af90 2024-03-19T06:07:17.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:17.918+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc9c400ae20 con 0x7fc9cc15af90 2024-03-19T06:07:18.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:07:18.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:07:18.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.139+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9cc151810 con 0x7fc9cc15af90 2024-03-19T06:07:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.203+0000 7fc9c2a00640 1 -- 172.21.15.17:0/1176879425 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fc9cc151810 con 0x7fc9cc15af90 2024-03-19T06:07:18.195 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:18.195 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.205+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 msgr2=0x7fc9ac06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.205+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 0x7fc9ac06e0e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc008890 tx=0x7fc9bc008040 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.205+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 msgr2=0x7fc9cc15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400ca80 tx=0x7fc9c400cf40 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 shutdown_connections 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9cc15af90 0x7fc9cc15a360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc9cc151cb0 0x7fc9cc158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc9ac06bc20 0x7fc9ac06e0e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 --2- 172.21.15.17:0/1176879425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9cc06cee0 0x7fc9cc0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 >> 172.21.15.17:0/1176879425 conn(0x7fc9cc06e630 msgr2=0x7fc9cc15b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 shutdown_connections 2024-03-19T06:07:18.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.206+0000 7fc9cbe00640 1 -- 172.21.15.17:0/1176879425 wait complete. 2024-03-19T06:07:18.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.495+0000 7fcaea800640 1 Processor -- start 2024-03-19T06:07:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.496+0000 7fcaea800640 1 -- start start 2024-03-19T06:07:18.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.497+0000 7fcaea800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcae4159c10 0x7fcae415b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.497+0000 7fcaea800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae40caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.497+0000 7fcaea800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae415a200 con 0x7fcae40c9410 2024-03-19T06:07:18.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.497+0000 7fcaea800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae415e0f0 con 0x7fcae4159c10 2024-03-19T06:07:18.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.497+0000 7fcaea800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae40caac0 con 0x7fcae415dc60 2024-03-19T06:07:18.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.499+0000 7fcae9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae40caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.500+0000 7fcae9400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcae40c9410 0x7fcae40ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:54794/0 (socket says 172.21.15.17:54794) 2024-03-19T06:07:18.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.500+0000 7fcae9400640 1 -- 172.21.15.17:0/662209274 learned_addr learned my addr 172.21.15.17:0/662209274 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:18.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.500+0000 7fcae8a00640 1 --2- 172.21.15.17:0/662209274 >> v2:172.21.15.153:3300/0 conn(0x7fcae4159c10 0x7fcae415b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.507+0000 7fcae9e00640 1 -- 172.21.15.17:0/662209274 >> v2:172.21.15.153:3300/0 conn(0x7fcae4159c10 msgr2=0x7fcae415b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:18.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.507+0000 7fcae9e00640 1 --2- 172.21.15.17:0/662209274 >> v2:172.21.15.153:3300/0 conn(0x7fcae4159c10 0x7fcae415b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.507+0000 7fcae9e00640 1 -- 172.21.15.17:0/662209274 >> v1:172.21.15.153:6789/0 conn(0x7fcae40c9410 legacy=0x7fcae40ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.507+0000 7fcae9e00640 1 -- 172.21.15.17:0/662209274 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae415a4c0 con 0x7fcae415dc60 2024-03-19T06:07:18.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.514+0000 7fcae9e00640 1 --2- 172.21.15.17:0/662209274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae40caea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009d90 tx=0x7fcadc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef59214e4bd293d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.525+0000 7fcae3e00640 1 -- 172.21.15.17:0/662209274 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc039070 con 0x7fcae415dc60 2024-03-19T06:07:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.525+0000 7fcae3e00640 1 -- 172.21.15.17:0/662209274 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc02cc50 con 0x7fcae415dc60 2024-03-19T06:07:18.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.525+0000 7fcae3e00640 1 -- 172.21.15.17:0/662209274 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc034440 con 0x7fcae415dc60 2024-03-19T06:07:18.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 -- 172.21.15.17:0/662209274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 msgr2=0x7fcae40caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 --2- 172.21.15.17:0/662209274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae40caea0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009d90 tx=0x7fcadc02bea0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 -- 172.21.15.17:0/662209274 shutdown_connections 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 --2- 172.21.15.17:0/662209274 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae40caea0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 --2- 172.21.15.17:0/662209274 >> v2:172.21.15.153:3300/0 conn(0x7fcae4159c10 0x7fcae415b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 -- 172.21.15.17:0/662209274 >> 172.21.15.17:0/662209274 conn(0x7fcae4072360 msgr2=0x7fcae4072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 -- 172.21.15.17:0/662209274 shutdown_connections 2024-03-19T06:07:18.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.526+0000 7fcaea800640 1 -- 172.21.15.17:0/662209274 wait complete. 2024-03-19T06:07:18.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.528+0000 7fcaea800640 1 Processor -- start 2024-03-19T06:07:18.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.529+0000 7fcaea800640 1 -- start start 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcae4159c10 0x7fcae40cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae4155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415d180 con 0x7fcae40c9410 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415aa80 con 0x7fcae4159c10 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.530+0000 7fcaea800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae415d460 con 0x7fcae415dc60 2024-03-19T06:07:18.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.531+0000 7fcae9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.531+0000 7fcae9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46822/0 (socket says 172.21.15.17:46822) 2024-03-19T06:07:18.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.531+0000 7fcae9400640 1 -- 172.21.15.17:0/2187082941 learned_addr learned my addr 172.21.15.17:0/2187082941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:18.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.532+0000 7fcae8a00640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcae4159c10 0x7fcae40cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9e00640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae4155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9400640 1 -- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 msgr2=0x7fcae4155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9400640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae4155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9400640 1 -- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcae4159c10 msgr2=0x7fcae40cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9400640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcae4159c10 0x7fcae40cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:18.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.536+0000 7fcae9400640 1 -- 172.21.15.17:0/2187082941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40c7270 con 0x7fcae40c9410 2024-03-19T06:07:18.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.538+0000 7fcae9400640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c400 tx=0x7fcad400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.547+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4017070 con 0x7fcae40c9410 2024-03-19T06:07:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.547+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad4005ce0 con 0x7fcae40c9410 2024-03-19T06:07:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.547+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40072f0 con 0x7fcae40c9410 2024-03-19T06:07:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.547+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae41ef800 con 0x7fcae40c9410 2024-03-19T06:07:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.547+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae41efdc0 con 0x7fcae40c9410 2024-03-19T06:07:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.548+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae40c8f30 con 0x7fcae40c9410 2024-03-19T06:07:18.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.587+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcad401a070 con 0x7fcae40c9410 2024-03-19T06:07:18.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.589+0000 7fcae1600640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 0x7fcac806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:18.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.590+0000 7fcae8a00640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 0x7fcac806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:18.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.591+0000 7fcae8a00640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 0x7fcac806e0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcae4158f60 tx=0x7fcad8009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:18.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.939+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcad40567a0 con 0x7fcae40c9410 2024-03-19T06:07:18.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:18.941+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fcae40c8f30 con 0x7fcae40c9410 2024-03-19T06:07:19.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.164+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcae404f050 con 0x7fcae40c9410 2024-03-19T06:07:19.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.267+0000 7fcae1600640 1 -- 172.21.15.17:0/2187082941 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fcad4021020 con 0x7fcae40c9410 2024-03-19T06:07:19.259 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:19.259 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 msgr2=0x7fcac806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 0x7fcac806e0e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcae4158f60 tx=0x7fcad8009190 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 msgr2=0x7fcae40cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcad400c400 tx=0x7fcad400c8c0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 shutdown_connections 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcae415dc60 0x7fcae4155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcac806bc20 0x7fcac806e0e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcae4159c10 0x7fcae40cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 --2- 172.21.15.17:0/2187082941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcae40c9410 0x7fcae40cf5d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 >> 172.21.15.17:0/2187082941 conn(0x7fcae4072360 msgr2=0x7fcae415c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 shutdown_connections 2024-03-19T06:07:19.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.271+0000 7fcaea800640 1 -- 172.21.15.17:0/2187082941 wait complete. 2024-03-19T06:07:19.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-19T06:07:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.500+0000 7fe251600640 1 Processor -- start 2024-03-19T06:07:19.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.500+0000 7fe251600640 1 -- start start 2024-03-19T06:07:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.502+0000 7fe251600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c1541d0 0x7fe24c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.502+0000 7fe251600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe24c15d860 0x7fe24c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.502+0000 7fe251600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c15d3b0 con 0x7fe24c0cb8d0 2024-03-19T06:07:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.502+0000 7fe251600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c15a0d0 con 0x7fe24c15d860 2024-03-19T06:07:19.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.502+0000 7fe251600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15a3b0 con 0x7fe24c1541d0 2024-03-19T06:07:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.504+0000 7fe24b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe24c15d860 0x7fe24c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.504+0000 7fe243e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe24c0cb8d0 0x7fe24c0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47356/0 (socket says 172.21.15.17:47356) 2024-03-19T06:07:19.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.504+0000 7fe243e00640 1 -- 172.21.15.17:0/1779497889 learned_addr learned my addr 172.21.15.17:0/1779497889 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:19.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.504+0000 7fe24aa00640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c1541d0 0x7fe24c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.510+0000 7fe24b400640 1 -- 172.21.15.17:0/1779497889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c1541d0 msgr2=0x7fe24c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.510+0000 7fe24b400640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c1541d0 0x7fe24c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.510+0000 7fe24b400640 1 -- 172.21.15.17:0/1779497889 >> v1:172.21.15.17:6789/0 conn(0x7fe24c0cb8d0 legacy=0x7fe24c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.510+0000 7fe24b400640 1 -- 172.21.15.17:0/1779497889 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c15e230 con 0x7fe24c15d860 2024-03-19T06:07:19.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.513+0000 7fe24b400640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c15d860 0x7fe24c15dcf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe244009d90 tx=0x7fe24402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb026f624dbc4cf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:19.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.523+0000 7fe24a000640 1 -- 172.21.15.17:0/1779497889 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244039070 con 0x7fe24c15d860 2024-03-19T06:07:19.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.523+0000 7fe24a000640 1 -- 172.21.15.17:0/1779497889 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24402cce0 con 0x7fe24c15d860 2024-03-19T06:07:19.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.523+0000 7fe24a000640 1 -- 172.21.15.17:0/1779497889 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244034660 con 0x7fe24c15d860 2024-03-19T06:07:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 -- 172.21.15.17:0/1779497889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c15d860 msgr2=0x7fe24c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c15d860 0x7fe24c15dcf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe244009d90 tx=0x7fe24402bf30 comp rx=0 tx=0).stop 2024-03-19T06:07:19.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 -- 172.21.15.17:0/1779497889 shutdown_connections 2024-03-19T06:07:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c15d860 0x7fe24c15dcf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 --2- 172.21.15.17:0/1779497889 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c1541d0 0x7fe24c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.524+0000 7fe251600640 1 -- 172.21.15.17:0/1779497889 >> 172.21.15.17:0/1779497889 conn(0x7fe24c06baf0 msgr2=0x7fe24c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.525+0000 7fe251600640 1 -- 172.21.15.17:0/1779497889 shutdown_connections 2024-03-19T06:07:19.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.525+0000 7fe251600640 1 -- 172.21.15.17:0/1779497889 wait complete. 2024-03-19T06:07:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.527+0000 7fe251600640 1 Processor -- start 2024-03-19T06:07:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.528+0000 7fe251600640 1 -- start start 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c0cb8d0 0x7fe24c0cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 0x7fe24c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c159da0 con 0x7fe24c1541d0 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15a970 con 0x7fe24c0cb8d0 2024-03-19T06:07:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.529+0000 7fe251600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15ac50 con 0x7fe24c15d860 2024-03-19T06:07:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.530+0000 7fe243e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.530+0000 7fe243e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46834/0 (socket says 172.21.15.17:46834) 2024-03-19T06:07:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.530+0000 7fe243e00640 1 -- 172.21.15.17:0/229165554 learned_addr learned my addr 172.21.15.17:0/229165554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.531+0000 7fe24aa00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c0cb8d0 0x7fe24c0cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.531+0000 7fe24b400640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 0x7fe24c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe243e00640 1 -- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 msgr2=0x7fe24c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe243e00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 0x7fe24c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe243e00640 1 -- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c0cb8d0 msgr2=0x7fe24c0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe243e00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c0cb8d0 0x7fe24c0cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe243e00640 1 -- 172.21.15.17:0/229165554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c14e360 con 0x7fe24c1541d0 2024-03-19T06:07:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.535+0000 7fe24b400640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 0x7fe24c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:07:19.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.538+0000 7fe243e00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c3f0 tx=0x7fe23400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.541+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234017070 con 0x7fe24c1541d0 2024-03-19T06:07:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.541+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c157e60 con 0x7fe24c1541d0 2024-03-19T06:07:19.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.541+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c14e080 con 0x7fe24c1541d0 2024-03-19T06:07:19.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.543+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c069be0 con 0x7fe24c1541d0 2024-03-19T06:07:19.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.547+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe234005ce0 con 0x7fe24c1541d0 2024-03-19T06:07:19.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.547+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234021060 con 0x7fe24c1541d0 2024-03-19T06:07:19.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.850+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fe23401a070 con 0x7fe24c1541d0 2024-03-19T06:07:19.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.852+0000 7fe242a00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 0x7fe22806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:19.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.852+0000 7fe24aa00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 0x7fe22806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:19.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.854+0000 7fe24aa00640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 0x7fe22806e090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009b40 tx=0x7fe23c009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:19.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.876+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fe234056a40 con 0x7fe24c1541d0 2024-03-19T06:07:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:19.877+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fe2340589a0 con 0x7fe24c1541d0 2024-03-19T06:07:20.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:20.131+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe24c072140 con 0x7fe24c1541d0 2024-03-19T06:07:21.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.227+0000 7fe242a00640 1 -- 172.21.15.17:0/229165554 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v9) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe23405ca40 con 0x7fe24c1541d0 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.230+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 msgr2=0x7fe22806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.230+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 0x7fe22806e090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009b40 tx=0x7fe23c009190 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 msgr2=0x7fe24c15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c3f0 tx=0x7fe23400c8b0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 shutdown_connections 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fe24c15d860 0x7fe24c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe24c1541d0 0x7fe24c15c270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fe22806bbd0 0x7fe22806e090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 --2- 172.21.15.17:0/229165554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe24c0cb8d0 0x7fe24c0cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 >> 172.21.15.17:0/229165554 conn(0x7fe24c06baf0 msgr2=0x7fe24c0b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:21.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 shutdown_connections 2024-03-19T06:07:21.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.231+0000 7fe251600640 1 -- 172.21.15.17:0/229165554 wait complete. 2024-03-19T06:07:21.243 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-03-19T06:07:21.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-19T06:07:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.479+0000 7f4bfa600640 1 Processor -- start 2024-03-19T06:07:21.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.479+0000 7f4bfa600640 1 -- start start 2024-03-19T06:07:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.481+0000 7f4bfa600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf40c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.481+0000 7f4bfa600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bf40c54e0 0x7f4bf4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.481+0000 7f4bfa600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf4156a40 con 0x7f4bf40c89d0 2024-03-19T06:07:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.481+0000 7f4bfa600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf4157650 con 0x7f4bf40c54e0 2024-03-19T06:07:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.481+0000 7f4bfa600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4156d20 con 0x7f4bf4150a10 2024-03-19T06:07:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.482+0000 7f4bf3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bf40c54e0 0x7f4bf4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.482+0000 7f4bf3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4bf40c54e0 0x7f4bf4071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36106/0 (socket says 172.21.15.17:36106) 2024-03-19T06:07:21.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.482+0000 7f4bf3e00640 1 -- 172.21.15.17:0/4081267714 learned_addr learned my addr 172.21.15.17:0/4081267714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.484+0000 7f4bf3e00640 1 -- 172.21.15.17:0/4081267714 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 msgr2=0x7f4bf40c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.484+0000 7f4bf3e00640 1 --2- 172.21.15.17:0/4081267714 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf40c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.484+0000 7f4bf3e00640 1 -- 172.21.15.17:0/4081267714 >> v1:172.21.15.153:6789/0 conn(0x7f4bf40c89d0 legacy=0x7f4bf406e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.484+0000 7f4bf3e00640 1 -- 172.21.15.17:0/4081267714 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4157000 con 0x7f4bf40c54e0 2024-03-19T06:07:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.487+0000 7f4bf3e00640 1 --2- 172.21.15.17:0/4081267714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf4071bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009870 tx=0x7f4bdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536034fdd4eea78b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.491+0000 7f4bf3400640 1 -- 172.21.15.17:0/4081267714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc034070 con 0x7f4bf40c54e0 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.491+0000 7f4bf3400640 1 -- 172.21.15.17:0/4081267714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc030840 con 0x7f4bf40c54e0 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.491+0000 7f4bf3400640 1 -- 172.21.15.17:0/4081267714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc030c10 con 0x7f4bf40c54e0 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 -- 172.21.15.17:0/4081267714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 msgr2=0x7f4bf4071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 --2- 172.21.15.17:0/4081267714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf4071bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009870 tx=0x7f4bdc02b980 comp rx=0 tx=0).stop 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 -- 172.21.15.17:0/4081267714 shutdown_connections 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 --2- 172.21.15.17:0/4081267714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf4071bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 --2- 172.21.15.17:0/4081267714 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf40c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 -- 172.21.15.17:0/4081267714 >> 172.21.15.17:0/4081267714 conn(0x7f4bf406d770 msgr2=0x7f4bf406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 -- 172.21.15.17:0/4081267714 shutdown_connections 2024-03-19T06:07:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.492+0000 7f4bfa600640 1 -- 172.21.15.17:0/4081267714 wait complete. 2024-03-19T06:07:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.494+0000 7f4bfa600640 1 Processor -- start 2024-03-19T06:07:21.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.494+0000 7f4bfa600640 1 -- start start 2024-03-19T06:07:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf40c89d0 0x7f4bf40ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4150f70 con 0x7f4bf40c54e0 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf4150df0 con 0x7f4bf40c89d0 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bfa600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf406ee10 con 0x7f4bf4150a10 2024-03-19T06:07:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.495+0000 7f4bf9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.496+0000 7f4bf9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36108/0 (socket says 172.21.15.17:36108) 2024-03-19T06:07:21.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.496+0000 7f4bf9200640 1 -- 172.21.15.17:0/3283411098 learned_addr learned my addr 172.21.15.17:0/3283411098 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.500+0000 7f4bf9200640 1 -- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 msgr2=0x7f4bf414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.500+0000 7f4bf9200640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.500+0000 7f4bf9200640 1 -- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf40c89d0 msgr2=0x7f4bf40ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.500+0000 7f4bf9200640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf40c89d0 0x7f4bf40ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:21.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.500+0000 7f4bf9200640 1 -- 172.21.15.17:0/3283411098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf41556f0 con 0x7f4bf40c54e0 2024-03-19T06:07:21.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.504+0000 7f4bf9200640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4be400ba50 tx=0x7f4be400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.508+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4019070 con 0x7f4bf40c54e0 2024-03-19T06:07:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.508+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be400cc00 con 0x7f4bf40c54e0 2024-03-19T06:07:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.508+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4014440 con 0x7f4bf40c54e0 2024-03-19T06:07:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.508+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf4155990 con 0x7f4bf40c54e0 2024-03-19T06:07:21.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.508+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf414af70 con 0x7f4bf40c54e0 2024-03-19T06:07:21.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.510+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf404f050 con 0x7f4bf40c54e0 2024-03-19T06:07:21.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.533+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4be401c070 con 0x7f4bf40c54e0 2024-03-19T06:07:21.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.534+0000 7f4bf0c00640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 0x7f4bd006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:21.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.534+0000 7f4bf3e00640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 0x7f4bd006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:21.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.535+0000 7f4bf3e00640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 0x7f4bd006e0e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc036000 tx=0x7f4bdc03b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:21.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.849+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4be40574a0 con 0x7f4bf40c54e0 2024-03-19T06:07:21.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:21.851+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4be4023070 con 0x7f4bf40c54e0 2024-03-19T06:07:22.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.102+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f4bf4150230 con 0x7f4bf40c54e0 2024-03-19T06:07:22.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.868+0000 7f4bf0c00640 1 -- 172.21.15.17:0/3283411098 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4be4059b00 con 0x7f4bf40c54e0 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 msgr2=0x7f4bd006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 0x7f4bd006e0e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc036000 tx=0x7f4bdc03b040 comp rx=0 tx=0).stop 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 msgr2=0x7f4bf41f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4be400ba50 tx=0x7f4be400bf10 comp rx=0 tx=0).stop 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 shutdown_connections 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4bf4150a10 0x7f4bf414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4bd006bc20 0x7f4bd006e0e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4bf40c89d0 0x7f4bf40ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 --2- 172.21.15.17:0/3283411098 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4bf40c54e0 0x7f4bf41f3ff0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.871+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 >> 172.21.15.17:0/3283411098 conn(0x7f4bf406d770 msgr2=0x7f4bf40c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.872+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 shutdown_connections 2024-03-19T06:07:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:22.872+0000 7f4bfa600640 1 -- 172.21.15.17:0/3283411098 wait complete. 2024-03-19T06:07:22.884 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-19T06:07:23.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.113+0000 7f7a83400640 1 Processor -- start 2024-03-19T06:07:23.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.114+0000 7f7a83400640 1 -- start start 2024-03-19T06:07:23.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.115+0000 7f7a83400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:23.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.115+0000 7f7a83400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c0c6f50 con 0x7f7a7c0c9b30 2024-03-19T06:07:23.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.115+0000 7f7a83400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c06af50 con 0x7f7a7c0c8b30 2024-03-19T06:07:23.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.115+0000 7f7a83400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c71f0 con 0x7f7a7c151d20 2024-03-19T06:07:23.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.180+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.181+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:54760/0 (socket says 172.21.15.17:54760) 2024-03-19T06:07:23.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.181+0000 7f7a80a00640 1 -- 172.21.15.17:0/1645490016 learned_addr learned my addr 172.21.15.17:0/1645490016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:23.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.188+0000 7f7a80a00640 1 -- 172.21.15.17:0/1645490016 >> v1:172.21.15.153:6789/0 conn(0x7f7a7c0c8b30 legacy=0x7f7a7c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:23.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.188+0000 7f7a80a00640 1 -- 172.21.15.17:0/1645490016 >> v1:172.21.15.17:6789/0 conn(0x7f7a7c0c9b30 legacy=0x7f7a7c0c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:23.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.188+0000 7f7a80a00640 1 -- 172.21.15.17:0/1645490016 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c06b1f0 con 0x7f7a7c151d20 2024-03-19T06:07:23.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.198+0000 7f7a80a00640 1 --2- 172.21.15.17:0/1645490016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098a0 tx=0x7f7a6c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1379b1f4e73f6dc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.209+0000 7f7a7b400640 1 -- 172.21.15.17:0/1645490016 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c034070 con 0x7f7a7c151d20 2024-03-19T06:07:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.209+0000 7f7a7b400640 1 -- 172.21.15.17:0/1645490016 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c030840 con 0x7f7a7c151d20 2024-03-19T06:07:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.209+0000 7f7a7b400640 1 -- 172.21.15.17:0/1645490016 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c030c10 con 0x7f7a7c151d20 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.210+0000 7f7a83400640 1 -- 172.21.15.17:0/1645490016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 msgr2=0x7f7a7c0c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.210+0000 7f7a83400640 1 --2- 172.21.15.17:0/1645490016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0098a0 tx=0x7f7a6c02b980 comp rx=0 tx=0).stop 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.211+0000 7f7a83400640 1 -- 172.21.15.17:0/1645490016 shutdown_connections 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.211+0000 7f7a83400640 1 --2- 172.21.15.17:0/1645490016 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c151d20 0x7f7a7c0c95f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.211+0000 7f7a83400640 1 -- 172.21.15.17:0/1645490016 >> 172.21.15.17:0/1645490016 conn(0x7f7a7c06f8b0 msgr2=0x7f7a7c06fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.211+0000 7f7a83400640 1 -- 172.21.15.17:0/1645490016 shutdown_connections 2024-03-19T06:07:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.211+0000 7f7a83400640 1 -- 172.21.15.17:0/1645490016 wait complete. 2024-03-19T06:07:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.215+0000 7f7a83400640 1 Processor -- start 2024-03-19T06:07:23.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.216+0000 7f7a83400640 1 -- start start 2024-03-19T06:07:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c0c8b30 0x7f7a7c1e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7c0c9b30 0x7f7a7c0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c74d0 con 0x7f7a7c151d20 2024-03-19T06:07:23.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c152100 con 0x7f7a7c0c9b30 2024-03-19T06:07:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.218+0000 7f7a83400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c0c7650 con 0x7f7a7c0c8b30 2024-03-19T06:07:23.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.219+0000 7f7a81400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.219+0000 7f7a80a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c0c8b30 0x7f7a7c1e2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.219+0000 7f7a7be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7c0c9b30 0x7f7a7c0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.219+0000 7f7a81400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36118/0 (socket says 172.21.15.17:36118) 2024-03-19T06:07:23.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.219+0000 7f7a81400640 1 -- 172.21.15.17:0/948273842 learned_addr learned my addr 172.21.15.17:0/948273842 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.225+0000 7f7a81400640 1 -- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c0c8b30 msgr2=0x7f7a7c1e2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.225+0000 7f7a81400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c0c8b30 0x7f7a7c1e2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:23.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.225+0000 7f7a81400640 1 -- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7c0c9b30 msgr2=0x7f7a7c0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.225+0000 7f7a81400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7c0c9b30 0x7f7a7c0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:23.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.225+0000 7f7a81400640 1 -- 172.21.15.17:0/948273842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c149fa0 con 0x7f7a7c151d20 2024-03-19T06:07:23.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.228+0000 7f7a81400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c760 tx=0x7f7a7400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.234+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a74003b90 con 0x7f7a7c151d20 2024-03-19T06:07:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.234+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a74003d50 con 0x7f7a7c151d20 2024-03-19T06:07:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.234+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7400aa90 con 0x7f7a7c151d20 2024-03-19T06:07:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.234+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c147f40 con 0x7f7a7c151d20 2024-03-19T06:07:23.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.234+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c0cb710 con 0x7f7a7c151d20 2024-03-19T06:07:23.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.236+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c14a480 con 0x7f7a7c151d20 2024-03-19T06:07:23.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.266+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7a7400ac30 con 0x7f7a7c151d20 2024-03-19T06:07:23.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.267+0000 7f7a78c00640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 0x7f7a6006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:23.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.267+0000 7f7a80a00640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 0x7f7a6006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:23.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.268+0000 7f7a80a00640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 0x7f7a6006e110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c036000 tx=0x7f7a6c03c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:23.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.576+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7a74057780 con 0x7f7a7c151d20 2024-03-19T06:07:23.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.577+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f7a7c14a480 con 0x7f7a7c151d20 2024-03-19T06:07:23.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:23.842+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7a7c067d60 con 0x7f7a7c151d20 2024-03-19T06:07:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.066+0000 7f7a78c00640 1 -- 172.21.15.17:0/948273842 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a740596e0 con 0x7f7a7c151d20 2024-03-19T06:07:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 msgr2=0x7f7a6006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 0x7f7a6006e110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c036000 tx=0x7f7a6c03c040 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 msgr2=0x7f7a7c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400c760 tx=0x7f7a7400cc20 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 shutdown_connections 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a7c151d20 0x7f7a7c0cc450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7a6006bc50 0x7f7a6006e110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a7c0c9b30 0x7f7a7c0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 --2- 172.21.15.17:0/948273842 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7a7c0c8b30 0x7f7a7c1e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.069+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 >> 172.21.15.17:0/948273842 conn(0x7f7a7c06f8b0 msgr2=0x7f7a7c071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.070+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 shutdown_connections 2024-03-19T06:07:25.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.070+0000 7f7a83400640 1 -- 172.21.15.17:0/948273842 wait complete. 2024-03-19T06:07:25.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-19T06:07:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.318+0000 7f3993400640 1 Processor -- start 2024-03-19T06:07:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.318+0000 7f3993400640 1 -- start start 2024-03-19T06:07:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.319+0000 7f3993400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f398c154220 0x7f398c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.319+0000 7f3993400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.319+0000 7f3993400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c15a130 con 0x7f398c0cc570 2024-03-19T06:07:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.320+0000 7f3993400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398c0ca330 con 0x7f398c154220 2024-03-19T06:07:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.320+0000 7f3993400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c15a410 con 0x7f398c15de20 2024-03-19T06:07:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.321+0000 7f398be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.323+0000 7f398be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:54786/0 (socket says 172.21.15.17:54786) 2024-03-19T06:07:25.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.323+0000 7f398be00640 1 -- 172.21.15.17:0/2699869249 learned_addr learned my addr 172.21.15.17:0/2699869249 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.329+0000 7f398be00640 1 -- 172.21.15.17:0/2699869249 >> v2:172.21.15.17:3300/0 conn(0x7f398c154220 msgr2=0x7f398c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.329+0000 7f398be00640 1 --2- 172.21.15.17:0/2699869249 >> v2:172.21.15.17:3300/0 conn(0x7f398c154220 0x7f398c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.329+0000 7f398be00640 1 -- 172.21.15.17:0/2699869249 >> v1:172.21.15.17:6789/0 conn(0x7f398c0cc570 legacy=0x7f398c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:25.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.329+0000 7f398be00640 1 -- 172.21.15.17:0/2699869249 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c15a6f0 con 0x7f398c15de20 2024-03-19T06:07:25.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.335+0000 7f398be00640 1 --2- 172.21.15.17:0/2699869249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3974009870 tx=0x7f397402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20bbb9f1866af92f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.346+0000 7f398b400640 1 -- 172.21.15.17:0/2699869249 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974034070 con 0x7f398c15de20 2024-03-19T06:07:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.346+0000 7f398b400640 1 -- 172.21.15.17:0/2699869249 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974030840 con 0x7f398c15de20 2024-03-19T06:07:25.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.346+0000 7f398b400640 1 -- 172.21.15.17:0/2699869249 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974030c10 con 0x7f398c15de20 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 -- 172.21.15.17:0/2699869249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 msgr2=0x7f398c0cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 --2- 172.21.15.17:0/2699869249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3974009870 tx=0x7f397402b980 comp rx=0 tx=0).stop 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 -- 172.21.15.17:0/2699869249 shutdown_connections 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 --2- 172.21.15.17:0/2699869249 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c15de20 0x7f398c0cc030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 --2- 172.21.15.17:0/2699869249 >> v2:172.21.15.17:3300/0 conn(0x7f398c154220 0x7f398c0ca560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 -- 172.21.15.17:0/2699869249 >> 172.21.15.17:0/2699869249 conn(0x7f398c06c170 msgr2=0x7f398c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.347+0000 7f3993400640 1 -- 172.21.15.17:0/2699869249 shutdown_connections 2024-03-19T06:07:25.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.348+0000 7f3993400640 1 -- 172.21.15.17:0/2699869249 wait complete. 2024-03-19T06:07:25.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.350+0000 7f3993400640 1 Processor -- start 2024-03-19T06:07:25.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.350+0000 7f3993400640 1 -- start start 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 0x7f398c15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 0x7f398c1e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f398c15de20 0x7f398c14a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0cad20 con 0x7f398c154220 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c15acb0 con 0x7f398c15de20 2024-03-19T06:07:25.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.351+0000 7f3993400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398c159e20 con 0x7f398c0cc570 2024-03-19T06:07:25.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.353+0000 7f3990a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 0x7f398c15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.354+0000 7f3990a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 0x7f398c15be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:54792/0 (socket says 172.21.15.17:54792) 2024-03-19T06:07:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.354+0000 7f3990a00640 1 -- 172.21.15.17:0/422265896 learned_addr learned my addr 172.21.15.17:0/422265896 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.354+0000 7f398be00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 0x7f398c1e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.358+0000 7f398be00640 1 -- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 msgr2=0x7f398c15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.358+0000 7f398be00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 0x7f398c15be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.358+0000 7f398be00640 1 -- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f398c15de20 msgr2=0x7f398c14a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.358+0000 7f398be00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f398c15de20 0x7f398c14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:25.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.358+0000 7f398be00640 1 -- 172.21.15.17:0/422265896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c1e3730 con 0x7f398c154220 2024-03-19T06:07:25.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.362+0000 7f398be00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 0x7f398c1e43c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3974033000 tx=0x7f39740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.367+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974034040 con 0x7f398c154220 2024-03-19T06:07:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.368+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397403ada0 con 0x7f398c154220 2024-03-19T06:07:25.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.368+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c1e3190 con 0x7f398c154220 2024-03-19T06:07:25.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.368+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974044630 con 0x7f398c154220 2024-03-19T06:07:25.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.368+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c15b370 con 0x7f398c154220 2024-03-19T06:07:25.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.369+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c066b30 con 0x7f398c154220 2024-03-19T06:07:25.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.661+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f397404b060 con 0x7f398c154220 2024-03-19T06:07:25.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.662+0000 7f3988c00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 0x7f396806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:25.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.663+0000 7f3990a00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 0x7f396806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:25.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.665+0000 7f3990a00640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 0x7f396806e0e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e250 tx=0x7f397c00b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:25.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.676+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3974079400 con 0x7f398c154220 2024-03-19T06:07:25.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.677+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f397403f070 con 0x7f398c154220 2024-03-19T06:07:25.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:25.937+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f398c067d60 con 0x7f398c154220 2024-03-19T06:07:27.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.117+0000 7f3988c00640 1 -- 172.21.15.17:0/422265896 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f397407b360 con 0x7f398c154220 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 msgr2=0x7f396806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 0x7f396806e0e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e250 tx=0x7f397c00b040 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 msgr2=0x7f398c1e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 0x7f398c1e43c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3974033000 tx=0x7f39740046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 shutdown_connections 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f396806bc20 0x7f396806e0e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f398c15de20 0x7f398c14a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f398c154220 0x7f398c1e43c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 --2- 172.21.15.17:0/422265896 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f398c0cc570 0x7f398c15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 >> 172.21.15.17:0/422265896 conn(0x7f398c06c170 msgr2=0x7f398c1526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:27.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 shutdown_connections 2024-03-19T06:07:27.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.121+0000 7f3993400640 1 -- 172.21.15.17:0/422265896 wait complete. 2024-03-19T06:07:27.135 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-19T06:07:27.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:07:27.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.367+0000 7efee9400640 1 Processor -- start 2024-03-19T06:07:27.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.368+0000 7efee9400640 1 -- start start 2024-03-19T06:07:27.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.369+0000 7efee9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.369+0000 7efee9400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efee40c1e60 0x7efee406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.369+0000 7efee9400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40c27c0 con 0x7efee415b1d0 2024-03-19T06:07:27.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.369+0000 7efee9400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee4157f30 con 0x7efee40c1e60 2024-03-19T06:07:27.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.369+0000 7efee9400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee4152350 con 0x7efee4151f70 2024-03-19T06:07:27.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.371+0000 7efee2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.372+0000 7efee2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:54796/0 (socket says 172.21.15.17:54796) 2024-03-19T06:07:27.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.372+0000 7efee2800640 1 -- 172.21.15.17:0/1115402107 learned_addr learned my addr 172.21.15.17:0/1115402107 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.378+0000 7efee2800640 1 -- 172.21.15.17:0/1115402107 >> v2:172.21.15.17:3300/0 conn(0x7efee40c1e60 msgr2=0x7efee406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.378+0000 7efee2800640 1 --2- 172.21.15.17:0/1115402107 >> v2:172.21.15.17:3300/0 conn(0x7efee40c1e60 0x7efee406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.378+0000 7efee2800640 1 -- 172.21.15.17:0/1115402107 >> v1:172.21.15.17:6789/0 conn(0x7efee415b1d0 legacy=0x7efee41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:27.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.379+0000 7efee2800640 1 -- 172.21.15.17:0/1115402107 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4157be0 con 0x7efee4151f70 2024-03-19T06:07:27.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.384+0000 7efee2800640 1 --2- 172.21.15.17:0/1115402107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573031a6dd582f4e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.390+0000 7efee1400640 1 -- 172.21.15.17:0/1115402107 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc034070 con 0x7efee4151f70 2024-03-19T06:07:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.395+0000 7efee1400640 1 -- 172.21.15.17:0/1115402107 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc030840 con 0x7efee4151f70 2024-03-19T06:07:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.395+0000 7efee1400640 1 -- 172.21.15.17:0/1115402107 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc030c10 con 0x7efee4151f70 2024-03-19T06:07:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.395+0000 7efee9400640 1 -- 172.21.15.17:0/1115402107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 msgr2=0x7efee40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.395+0000 7efee9400640 1 --2- 172.21.15.17:0/1115402107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efecc009870 tx=0x7efecc02b980 comp rx=0 tx=0).stop 2024-03-19T06:07:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.395+0000 7efee9400640 1 -- 172.21.15.17:0/1115402107 shutdown_connections 2024-03-19T06:07:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.396+0000 7efee9400640 1 --2- 172.21.15.17:0/1115402107 >> v2:172.21.15.17:3300/0 conn(0x7efee40c1e60 0x7efee406e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.396+0000 7efee9400640 1 --2- 172.21.15.17:0/1115402107 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee4151f70 0x7efee40c7760 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.396+0000 7efee9400640 1 -- 172.21.15.17:0/1115402107 >> 172.21.15.17:0/1115402107 conn(0x7efee40c8910 msgr2=0x7efee40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.396+0000 7efee9400640 1 -- 172.21.15.17:0/1115402107 shutdown_connections 2024-03-19T06:07:27.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.396+0000 7efee9400640 1 -- 172.21.15.17:0/1115402107 wait complete. 2024-03-19T06:07:27.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.398+0000 7efee9400640 1 Processor -- start 2024-03-19T06:07:27.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.398+0000 7efee9400640 1 -- start start 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee40c1e60 0x7efee41504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efee4151f70 0x7efee40c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee415bcf0 con 0x7efee415b1d0 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee415ba10 con 0x7efee4151f70 2024-03-19T06:07:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.399+0000 7efee9400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee415bfd0 con 0x7efee40c1e60 2024-03-19T06:07:27.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.402+0000 7efee2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee40c1e60 0x7efee41504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.403+0000 7efee3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.403+0000 7efee3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36164/0 (socket says 172.21.15.17:36164) 2024-03-19T06:07:27.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.403+0000 7efee3200640 1 -- 172.21.15.17:0/2488062141 learned_addr learned my addr 172.21.15.17:0/2488062141 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:27.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.406+0000 7efee1e00640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efee4151f70 0x7efee40c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.409+0000 7efee3200640 1 -- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee40c1e60 msgr2=0x7efee41504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.409+0000 7efee3200640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee40c1e60 0x7efee41504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.409+0000 7efee3200640 1 -- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efee4151f70 msgr2=0x7efee40c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:27.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.409+0000 7efee3200640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efee4151f70 0x7efee40c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:27.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.409+0000 7efee3200640 1 -- 172.21.15.17:0/2488062141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee41e5240 con 0x7efee415b1d0 2024-03-19T06:07:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.413+0000 7efee3200640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efedc00b450 tx=0x7efedc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.419+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc015020 con 0x7efee415b1d0 2024-03-19T06:07:27.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.419+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc011890 con 0x7efee415b1d0 2024-03-19T06:07:27.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.419+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc011c60 con 0x7efee415b1d0 2024-03-19T06:07:27.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.419+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee41e5520 con 0x7efee415b1d0 2024-03-19T06:07:27.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.419+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee414fca0 con 0x7efee415b1d0 2024-03-19T06:07:27.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.421+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee4069be0 con 0x7efee415b1d0 2024-03-19T06:07:27.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.770+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efedc018020 con 0x7efee415b1d0 2024-03-19T06:07:27.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.772+0000 7efedaa00640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 0x7efec006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:27.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.773+0000 7efee2800640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 0x7efec006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:27.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.774+0000 7efee2800640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 0x7efec006e0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efecc036000 tx=0x7efecc008030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:27.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.810+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efedc011e00 con 0x7efee415b1d0 2024-03-19T06:07:27.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:27.811+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7efedc01f020 con 0x7efee415b1d0 2024-03-19T06:07:28.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.070+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efee41568e0 con 0x7efee415b1d0 2024-03-19T06:07:28.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.113+0000 7efedaa00640 1 -- 172.21.15.17:0/2488062141 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+6537 (secure 0 0 0) 0x7efedc00d040 con 0x7efee415b1d0 2024-03-19T06:07:28.106 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:28.106 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:26.068258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4279,"mds_1":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:07:28.106 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 13 2024-03-19T06:07:28.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.117+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 msgr2=0x7efec006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.117+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 0x7efec006e0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efecc036000 tx=0x7efecc008030 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.117+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 msgr2=0x7efee41f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.117+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efedc00b450 tx=0x7efedc00b910 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 shutdown_connections 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee415b1d0 0x7efee41f07d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efec006bc20 0x7efec006e0e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efee4151f70 0x7efee40c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 --2- 172.21.15.17:0/2488062141 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efee40c1e60 0x7efee41504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 >> 172.21.15.17:0/2488062141 conn(0x7efee40c8910 msgr2=0x7efee41573c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 shutdown_connections 2024-03-19T06:07:28.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.118+0000 7efee9400640 1 -- 172.21.15.17:0/2488062141 wait complete. 2024-03-19T06:07:28.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:28.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.364+0000 7fb45d600640 1 Processor -- start 2024-03-19T06:07:28.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.364+0000 7fb45d600640 1 -- start start 2024-03-19T06:07:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.365+0000 7fb45d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb458153e90 0x7fb4580caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.365+0000 7fb45d600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580cb400 0x7fb4580ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.365+0000 7fb45d600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb458154270 con 0x7fb4580ca610 2024-03-19T06:07:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.365+0000 7fb45d600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb458159cd0 con 0x7fb4580cb400 2024-03-19T06:07:28.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.365+0000 7fb45d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb458159fb0 con 0x7fb458153e90 2024-03-19T06:07:28.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.373+0000 7fb457400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580cb400 0x7fb4580ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.375+0000 7fb457400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580cb400 0x7fb4580ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36178/0 (socket says 172.21.15.17:36178) 2024-03-19T06:07:28.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.375+0000 7fb457400640 1 -- 172.21.15.17:0/2027943976 learned_addr learned my addr 172.21.15.17:0/2027943976 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.381+0000 7fb457400640 1 -- 172.21.15.17:0/2027943976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb458153e90 msgr2=0x7fb4580caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.381+0000 7fb457400640 1 --2- 172.21.15.17:0/2027943976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb458153e90 0x7fb4580caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.381+0000 7fb457400640 1 -- 172.21.15.17:0/2027943976 >> v1:172.21.15.153:6789/0 conn(0x7fb4580ca610 legacy=0x7fb45815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:28.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.381+0000 7fb457400640 1 -- 172.21.15.17:0/2027943976 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45815a290 con 0x7fb4580cb400 2024-03-19T06:07:28.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.384+0000 7fb457400640 1 --2- 172.21.15.17:0/2027943976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580cb400 0x7fb4580ca0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb440009870 tx=0x7fb44002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d567b479c524f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.390+0000 7fb456a00640 1 -- 172.21.15.17:0/2027943976 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440035020 con 0x7fb4580cb400 2024-03-19T06:07:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.390+0000 7fb456a00640 1 -- 172.21.15.17:0/2027943976 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440031640 con 0x7fb4580cb400 2024-03-19T06:07:28.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.390+0000 7fb456a00640 1 -- 172.21.15.17:0/2027943976 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44002d040 con 0x7fb4580cb400 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 -- 172.21.15.17:0/2027943976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580cb400 msgr2=0x7fb4580ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 --2- 172.21.15.17:0/2027943976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580cb400 0x7fb4580ca0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb440009870 tx=0x7fb44002b8f0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 -- 172.21.15.17:0/2027943976 shutdown_connections 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 --2- 172.21.15.17:0/2027943976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580cb400 0x7fb4580ca0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 --2- 172.21.15.17:0/2027943976 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb458153e90 0x7fb4580caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 -- 172.21.15.17:0/2027943976 >> 172.21.15.17:0/2027943976 conn(0x7fb45806b540 msgr2=0x7fb45806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 -- 172.21.15.17:0/2027943976 shutdown_connections 2024-03-19T06:07:28.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.391+0000 7fb45d600640 1 -- 172.21.15.17:0/2027943976 wait complete. 2024-03-19T06:07:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.393+0000 7fb45d600640 1 Processor -- start 2024-03-19T06:07:28.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.394+0000 7fb45d600640 1 -- start start 2024-03-19T06:07:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4580cb400 0x7fb45815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb458153e90 0x7fb4580cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580c6750 con 0x7fb4580ca610 2024-03-19T06:07:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a850 con 0x7fb458153e90 2024-03-19T06:07:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.395+0000 7fb45d600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580b5120 con 0x7fb4580cb400 2024-03-19T06:07:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.397+0000 7fb457e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.398+0000 7fb457e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36184/0 (socket says 172.21.15.17:36184) 2024-03-19T06:07:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.398+0000 7fb457e00640 1 -- 172.21.15.17:0/1719022486 learned_addr learned my addr 172.21.15.17:0/1719022486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.399+0000 7fb45cc00640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb458153e90 0x7fb4580cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.403+0000 7fb457e00640 1 -- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4580cb400 msgr2=0x7fb45815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.403+0000 7fb457e00640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4580cb400 0x7fb45815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.403+0000 7fb457e00640 1 -- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb458153e90 msgr2=0x7fb4580cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.403+0000 7fb457e00640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb458153e90 0x7fb4580cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:28.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.403+0000 7fb457e00640 1 -- 172.21.15.17:0/1719022486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45815ac40 con 0x7fb4580ca610 2024-03-19T06:07:28.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.408+0000 7fb457e00640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb44800b440 tx=0x7fb44800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.415+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448015020 con 0x7fb4580ca610 2024-03-19T06:07:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.415+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448011890 con 0x7fb4580ca610 2024-03-19T06:07:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.415+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448011c80 con 0x7fb4580ca610 2024-03-19T06:07:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.415+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4581e5e00 con 0x7fb4580ca610 2024-03-19T06:07:28.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.416+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45815af00 con 0x7fb4580ca610 2024-03-19T06:07:28.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.417+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45804f050 con 0x7fb4580ca610 2024-03-19T06:07:28.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.901+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb448018020 con 0x7fb4580ca610 2024-03-19T06:07:28.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.902+0000 7fb44fe00640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 0x7fb43406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:28.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.903+0000 7fb457400640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 0x7fb43406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:28.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.904+0000 7fb457400640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 0x7fb43406e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb440036000 tx=0x7fb440030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:28.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.948+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb448057700 con 0x7fb4580ca610 2024-03-19T06:07:28.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:28.949+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb44801f020 con 0x7fb4580ca610 2024-03-19T06:07:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.174+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4580c2c70 con 0x7fb4580ca610 2024-03-19T06:07:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.274+0000 7fb44fe00640 1 -- 172.21.15.17:0/1719022486 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fb44800d040 con 0x7fb4580ca610 2024-03-19T06:07:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:29.266 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 msgr2=0x7fb43406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 0x7fb43406e0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb440036000 tx=0x7fb440030000 comp rx=0 tx=0).stop 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 msgr2=0x7fb45815c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb44800b440 tx=0x7fb44800b900 comp rx=0 tx=0).stop 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 shutdown_connections 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb43406bc20 0x7fb43406e0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb458153e90 0x7fb4580cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb4580cb400 0x7fb45815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 --2- 172.21.15.17:0/1719022486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580ca610 0x7fb45815c110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.277+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 >> 172.21.15.17:0/1719022486 conn(0x7fb45806b540 msgr2=0x7fb458153090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.278+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 shutdown_connections 2024-03-19T06:07:29.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.278+0000 7fb45d600640 1 -- 172.21.15.17:0/1719022486 wait complete. 2024-03-19T06:07:29.292 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-19T06:07:29.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:07:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.512+0000 7f6759a00640 1 Processor -- start 2024-03-19T06:07:29.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.512+0000 7f6759a00640 1 -- start start 2024-03-19T06:07:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.514+0000 7f6759a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 0x7f67540c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.514+0000 7f6759a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f67540c2e10 0x7f67540c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.514+0000 7f6759a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540c2890 con 0x7f675415ba30 2024-03-19T06:07:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.514+0000 7f6759a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6754152290 con 0x7f67540c2e10 2024-03-19T06:07:29.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.514+0000 7f6759a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67540c9260 con 0x7f6754151eb0 2024-03-19T06:07:29.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.516+0000 7f6752a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 0x7f67540c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:29.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.518+0000 7f6752000640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f675415ba30 0x7f675406ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:41696/0 (socket says 172.21.15.17:41696) 2024-03-19T06:07:29.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.518+0000 7f6752000640 1 -- 172.21.15.17:0/2435831391 learned_addr learned my addr 172.21.15.17:0/2435831391 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:29.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.518+0000 7f6753400640 1 --2- 172.21.15.17:0/2435831391 >> v2:172.21.15.153:3300/0 conn(0x7f67540c2e10 0x7f67540c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:29.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.524+0000 7f6752a00640 1 -- 172.21.15.17:0/2435831391 >> v2:172.21.15.153:3300/0 conn(0x7f67540c2e10 msgr2=0x7f67540c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:29.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.524+0000 7f6752a00640 1 --2- 172.21.15.17:0/2435831391 >> v2:172.21.15.153:3300/0 conn(0x7f67540c2e10 0x7f67540c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.524+0000 7f6752a00640 1 -- 172.21.15.17:0/2435831391 >> v1:172.21.15.153:6789/0 conn(0x7f675415ba30 legacy=0x7f675406ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.524+0000 7f6752a00640 1 -- 172.21.15.17:0/2435831391 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540c9540 con 0x7f6754151eb0 2024-03-19T06:07:29.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.530+0000 7f6752a00640 1 --2- 172.21.15.17:0/2435831391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 0x7f67540c7fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6744009d90 tx=0x7f674402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c64ee443b1b009d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:29.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.542+0000 7f6751600640 1 -- 172.21.15.17:0/2435831391 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744039070 con 0x7f6754151eb0 2024-03-19T06:07:29.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.542+0000 7f6751600640 1 -- 172.21.15.17:0/2435831391 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674402cce0 con 0x7f6754151eb0 2024-03-19T06:07:29.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.542+0000 7f6751600640 1 -- 172.21.15.17:0/2435831391 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744034660 con 0x7f6754151eb0 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 -- 172.21.15.17:0/2435831391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 msgr2=0x7f67540c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 --2- 172.21.15.17:0/2435831391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 0x7f67540c7fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6744009d90 tx=0x7f674402bf30 comp rx=0 tx=0).stop 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 -- 172.21.15.17:0/2435831391 shutdown_connections 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 --2- 172.21.15.17:0/2435831391 >> v2:172.21.15.153:3300/0 conn(0x7f67540c2e10 0x7f67540c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 --2- 172.21.15.17:0/2435831391 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6754151eb0 0x7f67540c7fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 -- 172.21.15.17:0/2435831391 >> 172.21.15.17:0/2435831391 conn(0x7f67540709d0 msgr2=0x7f6754070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 -- 172.21.15.17:0/2435831391 shutdown_connections 2024-03-19T06:07:29.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.544+0000 7f6759a00640 1 -- 172.21.15.17:0/2435831391 wait complete. 2024-03-19T06:07:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.545+0000 7f6759a00640 1 Processor -- start 2024-03-19T06:07:29.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.545+0000 7f6759a00640 1 -- start start 2024-03-19T06:07:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.546+0000 7f6759a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67540c2e10 0x7f67541e54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.546+0000 7f6759a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.546+0000 7f6759a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f675415ba30 0x7f6754151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.546+0000 7f6759a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675415be70 con 0x7f6754151eb0 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.547+0000 7f6759a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675406e930 con 0x7f675415ba30 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.547+0000 7f6759a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675415bff0 con 0x7f67540c2e10 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.547+0000 7f6752000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.548+0000 7f6752000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36190/0 (socket says 172.21.15.17:36190) 2024-03-19T06:07:29.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.548+0000 7f6752000640 1 -- 172.21.15.17:0/3169039542 learned_addr learned my addr 172.21.15.17:0/3169039542 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.553+0000 7f6752000640 1 -- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67540c2e10 msgr2=0x7f67541e54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.553+0000 7f6752000640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67540c2e10 0x7f67541e54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.553+0000 7f6752000640 1 -- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f675415ba30 msgr2=0x7f6754151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:29.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.553+0000 7f6752000640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f675415ba30 0x7f6754151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:29.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.553+0000 7f6752000640 1 -- 172.21.15.17:0/3169039542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67541efe00 con 0x7f6754151eb0 2024-03-19T06:07:29.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.556+0000 7f6752000640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c3c0 tx=0x7f673c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.561+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c017070 con 0x7f6754151eb0 2024-03-19T06:07:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.561+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673c005ce0 con 0x7f6754151eb0 2024-03-19T06:07:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.561+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673c0072f0 con 0x7f6754151eb0 2024-03-19T06:07:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.561+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675415a2f0 con 0x7f6754151eb0 2024-03-19T06:07:29.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.561+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675415a890 con 0x7f6754151eb0 2024-03-19T06:07:29.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.563+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6754069be0 con 0x7f6754151eb0 2024-03-19T06:07:29.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.903+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f673c01a070 con 0x7f6754151eb0 2024-03-19T06:07:29.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.904+0000 7f674aa00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 0x7f673006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.905+0000 7f6752a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 0x7f673006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:29.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.906+0000 7f6752a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 0x7f673006e0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6744036000 tx=0x7f674402e000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:29.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.945+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f673c056740 con 0x7f6754151eb0 2024-03-19T06:07:29.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:29.946+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f6754069be0 con 0x7f6754151eb0 2024-03-19T06:07:30.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.187+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67541effd0 con 0x7f673006bc20 2024-03-19T06:07:30.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.221+0000 7f674aa00640 1 -- 172.21.15.17:0/3169039542 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332694 (secure 0 0 0) 0x7f674403a040 con 0x7f673006bc20 2024-03-19T06:07:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 msgr2=0x7f673006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 0x7f673006e0e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6744036000 tx=0x7f674402e000 comp rx=0 tx=0).stop 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 msgr2=0x7f6754150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f673c00c3c0 tx=0x7f673c00c880 comp rx=0 tx=0).stop 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 shutdown_connections 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f673006bc20 0x7f673006e0e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f675415ba30 0x7f6754151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6754151eb0 0x7f6754150f50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 --2- 172.21.15.17:0/3169039542 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f67540c2e10 0x7f67541e54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 >> 172.21.15.17:0/3169039542 conn(0x7f67540709d0 msgr2=0x7f67540c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 shutdown_connections 2024-03-19T06:07:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.230+0000 7f6759a00640 1 -- 172.21.15.17:0/3169039542 wait complete. 2024-03-19T06:07:30.245 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-19T06:07:29.319283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236696,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":4022272,"data_stored":2325620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005666"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044220+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:07:02.044220+0000","last_peered":"2024-03-19T06:07:02.044220+0000","last_clean":"2024-03-19T06:07:02.044220+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:07:02.044220+0000","last_undegraded":"2024-03-19T06:07:02.044220+0000","last_fullsized":"2024-03-19T06:07:02.044220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996193+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:07:01.996193+0000","last_peered":"2024-03-19T06:07:01.996193+0000","last_clean":"2024-03-19T06:07:01.996193+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:07:01.996193+0000","last_undegraded":"2024-03-19T06:07:01.996193+0000","last_fullsized":"2024-03-19T06:07:01.996193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992725+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:07:01.992725+0000","last_peered":"2024-03-19T06:07:01.992725+0000","last_clean":"2024-03-19T06:07:01.992725+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:07:01.992725+0000","last_undegraded":"2024-03-19T06:07:01.992725+0000","last_fullsized":"2024-03-19T06:07:01.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996588+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:07:01.996588+0000","last_peered":"2024-03-19T06:07:01.996588+0000","last_clean":"2024-03-19T06:07:01.996588+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:07:01.996588+0000","last_undegraded":"2024-03-19T06:07:01.996588+0000","last_fullsized":"2024-03-19T06:07:01.996588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043882+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:07:02.043882+0000","last_peered":"2024-03-19T06:07:02.043882+0000","last_clean":"2024-03-19T06:07:02.043882+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:07:02.043882+0000","last_undegraded":"2024-03-19T06:07:02.043882+0000","last_fullsized":"2024-03-19T06:07:02.043882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999673+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:07:01.999673+0000","last_peered":"2024-03-19T06:07:01.999673+0000","last_clean":"2024-03-19T06:07:01.999673+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:07:01.999673+0000","last_undegraded":"2024-03-19T06:07:01.999673+0000","last_fullsized":"2024-03-19T06:07:01.999673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242144+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:07:02.242144+0000","last_peered":"2024-03-19T06:07:02.242144+0000","last_clean":"2024-03-19T06:07:02.242144+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:07:02.242144+0000","last_undegraded":"2024-03-19T06:07:02.242144+0000","last_fullsized":"2024-03-19T06:07:02.242144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247982+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:07:02.247982+0000","last_peered":"2024-03-19T06:07:02.247982+0000","last_clean":"2024-03-19T06:07:02.247982+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:07:02.247982+0000","last_undegraded":"2024-03-19T06:07:02.247982+0000","last_fullsized":"2024-03-19T06:07:02.247982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.159056+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:07:02.159056+0000","last_peered":"2024-03-19T06:07:02.159056+0000","last_clean":"2024-03-19T06:07:02.159056+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:07:02.159056+0000","last_undegraded":"2024-03-19T06:07:02.159056+0000","last_fullsized":"2024-03-19T06:07:02.159056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241176+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:07:02.241176+0000","last_peered":"2024-03-19T06:07:02.241176+0000","last_clean":"2024-03-19T06:07:02.241176+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:07:02.241176+0000","last_undegraded":"2024-03-19T06:07:02.241176+0000","last_fullsized":"2024-03-19T06:07:02.241176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247222+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:07:02.247222+0000","last_peered":"2024-03-19T06:07:02.247222+0000","last_clean":"2024-03-19T06:07:02.247222+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:07:02.247222+0000","last_undegraded":"2024-03-19T06:07:02.247222+0000","last_fullsized":"2024-03-19T06:07:02.247222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000220+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:07:02.000220+0000","last_peered":"2024-03-19T06:07:02.000220+0000","last_clean":"2024-03-19T06:07:02.000220+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:07:02.000220+0000","last_undegraded":"2024-03-19T06:07:02.000220+0000","last_fullsized":"2024-03-19T06:07:02.000220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154988+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:07:02.154988+0000","last_peered":"2024-03-19T06:07:02.154988+0000","last_clean":"2024-03-19T06:07:02.154988+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:07:02.154988+0000","last_undegraded":"2024-03-19T06:07:02.154988+0000","last_fullsized":"2024-03-19T06:07:02.154988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.566454+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:07:24.566454+0000","last_peered":"2024-03-19T06:07:24.566454+0000","last_clean":"2024-03-19T06:07:24.566454+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:07:24.566454+0000","last_undegraded":"2024-03-19T06:07:24.566454+0000","last_fullsized":"2024-03-19T06:07:24.566454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000701+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:07:02.000701+0000","last_peered":"2024-03-19T06:07:02.000701+0000","last_clean":"2024-03-19T06:07:02.000701+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:07:02.000701+0000","last_undegraded":"2024-03-19T06:07:02.000701+0000","last_fullsized":"2024-03-19T06:07:02.000701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.994372+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:07:01.994372+0000","last_peered":"2024-03-19T06:07:01.994372+0000","last_clean":"2024-03-19T06:07:01.994372+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:07:01.994372+0000","last_undegraded":"2024-03-19T06:07:01.994372+0000","last_fullsized":"2024-03-19T06:07:01.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004136+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:07:02.004136+0000","last_peered":"2024-03-19T06:07:02.004136+0000","last_clean":"2024-03-19T06:07:02.004136+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:07:02.004136+0000","last_undegraded":"2024-03-19T06:07:02.004136+0000","last_fullsized":"2024-03-19T06:07:02.004136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001560+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:07:02.001560+0000","last_peered":"2024-03-19T06:07:02.001560+0000","last_clean":"2024-03-19T06:07:02.001560+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:07:02.001560+0000","last_undegraded":"2024-03-19T06:07:02.001560+0000","last_fullsized":"2024-03-19T06:07:02.001560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993604+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:07:01.993604+0000","last_peered":"2024-03-19T06:07:01.993604+0000","last_clean":"2024-03-19T06:07:01.993604+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:07:01.993604+0000","last_undegraded":"2024-03-19T06:07:01.993604+0000","last_fullsized":"2024-03-19T06:07:01.993604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.569184+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:07:24.569184+0000","last_peered":"2024-03-19T06:07:24.569184+0000","last_clean":"2024-03-19T06:07:24.569184+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:07:24.569184+0000","last_undegraded":"2024-03-19T06:07:24.569184+0000","last_fullsized":"2024-03-19T06:07:24.569184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004757+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:07:02.004757+0000","last_peered":"2024-03-19T06:07:02.004757+0000","last_clean":"2024-03-19T06:07:02.004757+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:07:02.004757+0000","last_undegraded":"2024-03-19T06:07:02.004757+0000","last_fullsized":"2024-03-19T06:07:02.004757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000136+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:07:02.000136+0000","last_peered":"2024-03-19T06:07:02.000136+0000","last_clean":"2024-03-19T06:07:02.000136+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:07:02.000136+0000","last_undegraded":"2024-03-19T06:07:02.000136+0000","last_fullsized":"2024-03-19T06:07:02.000136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.567976+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:07:24.567976+0000","last_peered":"2024-03-19T06:07:24.567976+0000","last_clean":"2024-03-19T06:07:24.567976+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:07:24.567976+0000","last_undegraded":"2024-03-19T06:07:24.567976+0000","last_fullsized":"2024-03-19T06:07:24.567976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001003+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:07:02.001003+0000","last_peered":"2024-03-19T06:07:02.001003+0000","last_clean":"2024-03-19T06:07:02.001003+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:07:02.001003+0000","last_undegraded":"2024-03-19T06:07:02.001003+0000","last_fullsized":"2024-03-19T06:07:02.001003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043713+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:07:02.043713+0000","last_peered":"2024-03-19T06:07:02.043713+0000","last_clean":"2024-03-19T06:07:02.043713+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:07:02.043713+0000","last_undegraded":"2024-03-19T06:07:02.043713+0000","last_fullsized":"2024-03-19T06:07:02.043713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.549178+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:07:24.549178+0000","last_peered":"2024-03-19T06:07:24.549178+0000","last_clean":"2024-03-19T06:07:24.549178+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:07:24.549178+0000","last_undegraded":"2024-03-19T06:07:24.549178+0000","last_fullsized":"2024-03-19T06:07:24.549178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000323+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:07:02.000323+0000","last_peered":"2024-03-19T06:07:02.000323+0000","last_clean":"2024-03-19T06:07:02.000323+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:07:02.000323+0000","last_undegraded":"2024-03-19T06:07:02.000323+0000","last_fullsized":"2024-03-19T06:07:02.000323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997387+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:07:01.997387+0000","last_peered":"2024-03-19T06:07:01.997387+0000","last_clean":"2024-03-19T06:07:01.997387+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:07:01.997387+0000","last_undegraded":"2024-03-19T06:07:01.997387+0000","last_fullsized":"2024-03-19T06:07:01.997387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005594+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:07:02.005594+0000","last_peered":"2024-03-19T06:07:02.005594+0000","last_clean":"2024-03-19T06:07:02.005594+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:07:02.005594+0000","last_undegraded":"2024-03-19T06:07:02.005594+0000","last_fullsized":"2024-03-19T06:07:02.005594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246594+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:07:02.246594+0000","last_peered":"2024-03-19T06:07:02.246594+0000","last_clean":"2024-03-19T06:07:02.246594+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:07:02.246594+0000","last_undegraded":"2024-03-19T06:07:02.246594+0000","last_fullsized":"2024-03-19T06:07:02.246594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004937+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:07:02.004937+0000","last_peered":"2024-03-19T06:07:02.004937+0000","last_clean":"2024-03-19T06:07:02.004937+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:07:02.004937+0000","last_undegraded":"2024-03-19T06:07:02.004937+0000","last_fullsized":"2024-03-19T06:07:02.004937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242514+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:07:02.242514+0000","last_peered":"2024-03-19T06:07:02.242514+0000","last_clean":"2024-03-19T06:07:02.242514+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:07:02.242514+0000","last_undegraded":"2024-03-19T06:07:02.242514+0000","last_fullsized":"2024-03-19T06:07:02.242514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042542+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:07:02.042542+0000","last_peered":"2024-03-19T06:07:02.042542+0000","last_clean":"2024-03-19T06:07:02.042542+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:07:02.042542+0000","last_undegraded":"2024-03-19T06:07:02.042542+0000","last_fullsized":"2024-03-19T06:07:02.042542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247206+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:07:02.247206+0000","last_peered":"2024-03-19T06:07:02.247206+0000","last_clean":"2024-03-19T06:07:02.247206+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:07:02.247206+0000","last_undegraded":"2024-03-19T06:07:02.247206+0000","last_fullsized":"2024-03-19T06:07:02.247206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005335+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:07:02.005335+0000","last_peered":"2024-03-19T06:07:02.005335+0000","last_clean":"2024-03-19T06:07:02.005335+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:07:02.005335+0000","last_undegraded":"2024-03-19T06:07:02.005335+0000","last_fullsized":"2024-03-19T06:07:02.005335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002045+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:07:02.002045+0000","last_peered":"2024-03-19T06:07:02.002045+0000","last_clean":"2024-03-19T06:07:02.002045+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:07:02.002045+0000","last_undegraded":"2024-03-19T06:07:02.002045+0000","last_fullsized":"2024-03-19T06:07:02.002045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002384+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:07:02.002384+0000","last_peered":"2024-03-19T06:07:02.002384+0000","last_clean":"2024-03-19T06:07:02.002384+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:07:02.002384+0000","last_undegraded":"2024-03-19T06:07:02.002384+0000","last_fullsized":"2024-03-19T06:07:02.002384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246683+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:07:02.246683+0000","last_peered":"2024-03-19T06:07:02.246683+0000","last_clean":"2024-03-19T06:07:02.246683+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:07:02.246683+0000","last_undegraded":"2024-03-19T06:07:02.246683+0000","last_fullsized":"2024-03-19T06:07:02.246683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004767+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:07:02.004767+0000","last_peered":"2024-03-19T06:07:02.004767+0000","last_clean":"2024-03-19T06:07:02.004767+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:07:02.004767+0000","last_undegraded":"2024-03-19T06:07:02.004767+0000","last_fullsized":"2024-03-19T06:07:02.004767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002256+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:07:02.002256+0000","last_peered":"2024-03-19T06:07:02.002256+0000","last_clean":"2024-03-19T06:07:02.002256+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:07:02.002256+0000","last_undegraded":"2024-03-19T06:07:02.002256+0000","last_fullsized":"2024-03-19T06:07:02.002256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999231+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:07:01.999231+0000","last_peered":"2024-03-19T06:07:01.999231+0000","last_clean":"2024-03-19T06:07:01.999231+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:07:01.999231+0000","last_undegraded":"2024-03-19T06:07:01.999231+0000","last_fullsized":"2024-03-19T06:07:01.999231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004938+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:07:02.004938+0000","last_peered":"2024-03-19T06:07:02.004938+0000","last_clean":"2024-03-19T06:07:02.004938+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:07:02.004938+0000","last_undegraded":"2024-03-19T06:07:02.004938+0000","last_fullsized":"2024-03-19T06:07:02.004938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042134+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:07:02.042134+0000","last_peered":"2024-03-19T06:07:02.042134+0000","last_clean":"2024-03-19T06:07:02.042134+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:07:02.042134+0000","last_undegraded":"2024-03-19T06:07:02.042134+0000","last_fullsized":"2024-03-19T06:07:02.042134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240780+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:07:02.240780+0000","last_peered":"2024-03-19T06:07:02.240780+0000","last_clean":"2024-03-19T06:07:02.240780+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:07:02.240780+0000","last_undegraded":"2024-03-19T06:07:02.240780+0000","last_fullsized":"2024-03-19T06:07:02.240780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043281+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:07:02.043281+0000","last_peered":"2024-03-19T06:07:02.043281+0000","last_clean":"2024-03-19T06:07:02.043281+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:07:02.043281+0000","last_undegraded":"2024-03-19T06:07:02.043281+0000","last_fullsized":"2024-03-19T06:07:02.043281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993253+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:07:01.993253+0000","last_peered":"2024-03-19T06:07:01.993253+0000","last_clean":"2024-03-19T06:07:01.993253+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:07:01.993253+0000","last_undegraded":"2024-03-19T06:07:01.993253+0000","last_fullsized":"2024-03-19T06:07:01.993253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.562622+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:07:24.562622+0000","last_peered":"2024-03-19T06:07:24.562622+0000","last_clean":"2024-03-19T06:07:24.562622+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:07:24.562622+0000","last_undegraded":"2024-03-19T06:07:24.562622+0000","last_fullsized":"2024-03-19T06:07:24.562622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240669+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:07:02.240669+0000","last_peered":"2024-03-19T06:07:02.240669+0000","last_clean":"2024-03-19T06:07:02.240669+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:07:02.240669+0000","last_undegraded":"2024-03-19T06:07:02.240669+0000","last_fullsized":"2024-03-19T06:07:02.240669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155726+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:07:02.155726+0000","last_peered":"2024-03-19T06:07:02.155726+0000","last_clean":"2024-03-19T06:07:02.155726+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:07:02.155726+0000","last_undegraded":"2024-03-19T06:07:02.155726+0000","last_fullsized":"2024-03-19T06:07:02.155726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241852+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:07:02.241852+0000","last_peered":"2024-03-19T06:07:02.241852+0000","last_clean":"2024-03-19T06:07:02.241852+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:07:02.241852+0000","last_undegraded":"2024-03-19T06:07:02.241852+0000","last_fullsized":"2024-03-19T06:07:02.241852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999771+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:07:01.999771+0000","last_peered":"2024-03-19T06:07:01.999771+0000","last_clean":"2024-03-19T06:07:01.999771+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:07:01.999771+0000","last_undegraded":"2024-03-19T06:07:01.999771+0000","last_fullsized":"2024-03-19T06:07:01.999771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154712+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:07:02.154712+0000","last_peered":"2024-03-19T06:07:02.154712+0000","last_clean":"2024-03-19T06:07:02.154712+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:07:02.154712+0000","last_undegraded":"2024-03-19T06:07:02.154712+0000","last_fullsized":"2024-03-19T06:07:02.154712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.248178+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:07:02.248178+0000","last_peered":"2024-03-19T06:07:02.248178+0000","last_clean":"2024-03-19T06:07:02.248178+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:07:02.248178+0000","last_undegraded":"2024-03-19T06:07:02.248178+0000","last_fullsized":"2024-03-19T06:07:02.248178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005203+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:07:02.005203+0000","last_peered":"2024-03-19T06:07:02.005203+0000","last_clean":"2024-03-19T06:07:02.005203+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:07:02.005203+0000","last_undegraded":"2024-03-19T06:07:02.005203+0000","last_fullsized":"2024-03-19T06:07:02.005203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043106+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:07:02.043106+0000","last_peered":"2024-03-19T06:07:02.043106+0000","last_clean":"2024-03-19T06:07:02.043106+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:07:02.043106+0000","last_undegraded":"2024-03-19T06:07:02.043106+0000","last_fullsized":"2024-03-19T06:07:02.043106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242959+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:07:02.242959+0000","last_peered":"2024-03-19T06:07:02.242959+0000","last_clean":"2024-03-19T06:07:02.242959+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:07:02.242959+0000","last_undegraded":"2024-03-19T06:07:02.242959+0000","last_fullsized":"2024-03-19T06:07:02.242959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000308+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:07:02.000308+0000","last_peered":"2024-03-19T06:07:02.000308+0000","last_clean":"2024-03-19T06:07:02.000308+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:07:02.000308+0000","last_undegraded":"2024-03-19T06:07:02.000308+0000","last_fullsized":"2024-03-19T06:07:02.000308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244381+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:07:02.244381+0000","last_peered":"2024-03-19T06:07:02.244381+0000","last_clean":"2024-03-19T06:07:02.244381+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:07:02.244381+0000","last_undegraded":"2024-03-19T06:07:02.244381+0000","last_fullsized":"2024-03-19T06:07:02.244381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242409+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:07:02.242409+0000","last_peered":"2024-03-19T06:07:02.242409+0000","last_clean":"2024-03-19T06:07:02.242409+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:07:02.242409+0000","last_undegraded":"2024-03-19T06:07:02.242409+0000","last_fullsized":"2024-03-19T06:07:02.242409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001851+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:07:02.001851+0000","last_peered":"2024-03-19T06:07:02.001851+0000","last_clean":"2024-03-19T06:07:02.001851+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:07:02.001851+0000","last_undegraded":"2024-03-19T06:07:02.001851+0000","last_fullsized":"2024-03-19T06:07:02.001851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999778+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:07:01.999778+0000","last_peered":"2024-03-19T06:07:01.999778+0000","last_clean":"2024-03-19T06:07:01.999778+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:07:01.999778+0000","last_undegraded":"2024-03-19T06:07:01.999778+0000","last_fullsized":"2024-03-19T06:07:01.999778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240955+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:07:02.240955+0000","last_peered":"2024-03-19T06:07:02.240955+0000","last_clean":"2024-03-19T06:07:02.240955+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:07:02.240955+0000","last_undegraded":"2024-03-19T06:07:02.240955+0000","last_fullsized":"2024-03-19T06:07:02.240955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561648+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:07:24.561648+0000","last_peered":"2024-03-19T06:07:24.561648+0000","last_clean":"2024-03-19T06:07:24.561648+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:07:24.561648+0000","last_undegraded":"2024-03-19T06:07:24.561648+0000","last_fullsized":"2024-03-19T06:07:24.561648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043013+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:07:02.043013+0000","last_peered":"2024-03-19T06:07:02.043013+0000","last_clean":"2024-03-19T06:07:02.043013+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:07:02.043013+0000","last_undegraded":"2024-03-19T06:07:02.043013+0000","last_fullsized":"2024-03-19T06:07:02.043013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154227+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:07:02.154227+0000","last_peered":"2024-03-19T06:07:02.154227+0000","last_clean":"2024-03-19T06:07:02.154227+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:07:02.154227+0000","last_undegraded":"2024-03-19T06:07:02.154227+0000","last_fullsized":"2024-03-19T06:07:02.154227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155019+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:07:02.155019+0000","last_peered":"2024-03-19T06:07:02.155019+0000","last_clean":"2024-03-19T06:07:02.155019+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:07:02.155019+0000","last_undegraded":"2024-03-19T06:07:02.155019+0000","last_fullsized":"2024-03-19T06:07:02.155019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997053+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:07:01.997053+0000","last_peered":"2024-03-19T06:07:01.997053+0000","last_clean":"2024-03-19T06:07:01.997053+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:07:01.997053+0000","last_undegraded":"2024-03-19T06:07:01.997053+0000","last_fullsized":"2024-03-19T06:07:01.997053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242714+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:07:02.242714+0000","last_peered":"2024-03-19T06:07:02.242714+0000","last_clean":"2024-03-19T06:07:02.242714+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:07:02.242714+0000","last_undegraded":"2024-03-19T06:07:02.242714+0000","last_fullsized":"2024-03-19T06:07:02.242714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561680+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:07:24.561680+0000","last_peered":"2024-03-19T06:07:24.561680+0000","last_clean":"2024-03-19T06:07:24.561680+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:07:24.561680+0000","last_undegraded":"2024-03-19T06:07:24.561680+0000","last_fullsized":"2024-03-19T06:07:24.561680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.251618+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:07:02.251618+0000","last_peered":"2024-03-19T06:07:02.251618+0000","last_clean":"2024-03-19T06:07:02.251618+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:07:02.251618+0000","last_undegraded":"2024-03-19T06:07:02.251618+0000","last_fullsized":"2024-03-19T06:07:02.251618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042759+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:07:02.042759+0000","last_peered":"2024-03-19T06:07:02.042759+0000","last_clean":"2024-03-19T06:07:02.042759+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:07:02.042759+0000","last_undegraded":"2024-03-19T06:07:02.042759+0000","last_fullsized":"2024-03-19T06:07:02.042759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.809230+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:07:24.809230+0000","last_peered":"2024-03-19T06:07:24.809230+0000","last_clean":"2024-03-19T06:07:24.809230+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:07:24.809230+0000","last_undegraded":"2024-03-19T06:07:24.809230+0000","last_fullsized":"2024-03-19T06:07:24.809230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246888+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:07:02.246888+0000","last_peered":"2024-03-19T06:07:02.246888+0000","last_clean":"2024-03-19T06:07:02.246888+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:07:02.246888+0000","last_undegraded":"2024-03-19T06:07:02.246888+0000","last_fullsized":"2024-03-19T06:07:02.246888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241798+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:07:02.241798+0000","last_peered":"2024-03-19T06:07:02.241798+0000","last_clean":"2024-03-19T06:07:02.241798+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:07:02.241798+0000","last_undegraded":"2024-03-19T06:07:02.241798+0000","last_fullsized":"2024-03-19T06:07:02.241798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.546487+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:07:24.546487+0000","last_peered":"2024-03-19T06:07:24.546487+0000","last_clean":"2024-03-19T06:07:24.546487+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:07:24.546487+0000","last_undegraded":"2024-03-19T06:07:24.546487+0000","last_fullsized":"2024-03-19T06:07:24.546487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002159+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:07:02.002159+0000","last_peered":"2024-03-19T06:07:02.002159+0000","last_clean":"2024-03-19T06:07:02.002159+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:07:02.002159+0000","last_undegraded":"2024-03-19T06:07:02.002159+0000","last_fullsized":"2024-03-19T06:07:02.002159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001301+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:07:02.001301+0000","last_peered":"2024-03-19T06:07:02.001301+0000","last_clean":"2024-03-19T06:07:02.001301+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:07:02.001301+0000","last_undegraded":"2024-03-19T06:07:02.001301+0000","last_fullsized":"2024-03-19T06:07:02.001301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005101+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:07:02.005101+0000","last_peered":"2024-03-19T06:07:02.005101+0000","last_clean":"2024-03-19T06:07:02.005101+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:07:02.005101+0000","last_undegraded":"2024-03-19T06:07:02.005101+0000","last_fullsized":"2024-03-19T06:07:02.005101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002617+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:07:02.002617+0000","last_peered":"2024-03-19T06:07:02.002617+0000","last_clean":"2024-03-19T06:07:02.002617+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:07:02.002617+0000","last_undegraded":"2024-03-19T06:07:02.002617+0000","last_fullsized":"2024-03-19T06:07:02.002617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044065+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:07:02.044065+0000","last_peered":"2024-03-19T06:07:02.044065+0000","last_clean":"2024-03-19T06:07:02.044065+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:07:02.044065+0000","last_undegraded":"2024-03-19T06:07:02.044065+0000","last_fullsized":"2024-03-19T06:07:02.044065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.560919+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:07:24.560919+0000","last_peered":"2024-03-19T06:07:24.560919+0000","last_clean":"2024-03-19T06:07:24.560919+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:07:24.560919+0000","last_undegraded":"2024-03-19T06:07:24.560919+0000","last_fullsized":"2024-03-19T06:07:24.560919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993250+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:07:01.993250+0000","last_peered":"2024-03-19T06:07:01.993250+0000","last_clean":"2024-03-19T06:07:01.993250+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:07:01.993250+0000","last_undegraded":"2024-03-19T06:07:01.993250+0000","last_fullsized":"2024-03-19T06:07:01.993250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247142+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:07:02.247142+0000","last_peered":"2024-03-19T06:07:02.247142+0000","last_clean":"2024-03-19T06:07:02.247142+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:07:02.247142+0000","last_undegraded":"2024-03-19T06:07:02.247142+0000","last_fullsized":"2024-03-19T06:07:02.247142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.551476+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:07:24.551476+0000","last_peered":"2024-03-19T06:07:24.551476+0000","last_clean":"2024-03-19T06:07:24.551476+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:07:24.551476+0000","last_undegraded":"2024-03-19T06:07:24.551476+0000","last_fullsized":"2024-03-19T06:07:24.551476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992913+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:07:01.992913+0000","last_peered":"2024-03-19T06:07:01.992913+0000","last_clean":"2024-03-19T06:07:01.992913+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:07:01.992913+0000","last_undegraded":"2024-03-19T06:07:01.992913+0000","last_fullsized":"2024-03-19T06:07:01.992913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042627+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:07:02.042627+0000","last_peered":"2024-03-19T06:07:02.042627+0000","last_clean":"2024-03-19T06:07:02.042627+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:07:02.042627+0000","last_undegraded":"2024-03-19T06:07:02.042627+0000","last_fullsized":"2024-03-19T06:07:02.042627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001706+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:07:02.001706+0000","last_peered":"2024-03-19T06:07:02.001706+0000","last_clean":"2024-03-19T06:07:02.001706+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:07:02.001706+0000","last_undegraded":"2024-03-19T06:07:02.001706+0000","last_fullsized":"2024-03-19T06:07:02.001706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246483+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:07:02.246483+0000","last_peered":"2024-03-19T06:07:02.246483+0000","last_clean":"2024-03-19T06:07:02.246483+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:07:02.246483+0000","last_undegraded":"2024-03-19T06:07:02.246483+0000","last_fullsized":"2024-03-19T06:07:02.246483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156234+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:07:02.156234+0000","last_peered":"2024-03-19T06:07:02.156234+0000","last_clean":"2024-03-19T06:07:02.156234+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:07:02.156234+0000","last_undegraded":"2024-03-19T06:07:02.156234+0000","last_fullsized":"2024-03-19T06:07:02.156234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993429+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:07:01.993429+0000","last_peered":"2024-03-19T06:07:01.993429+0000","last_clean":"2024-03-19T06:07:01.993429+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:07:01.993429+0000","last_undegraded":"2024-03-19T06:07:01.993429+0000","last_fullsized":"2024-03-19T06:07:01.993429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993527+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:07:01.993527+0000","last_peered":"2024-03-19T06:07:01.993527+0000","last_clean":"2024-03-19T06:07:01.993527+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:07:01.993527+0000","last_undegraded":"2024-03-19T06:07:01.993527+0000","last_fullsized":"2024-03-19T06:07:01.993527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155399+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:07:02.155399+0000","last_peered":"2024-03-19T06:07:02.155399+0000","last_clean":"2024-03-19T06:07:02.155399+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:07:02.155399+0000","last_undegraded":"2024-03-19T06:07:02.155399+0000","last_fullsized":"2024-03-19T06:07:02.155399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043573+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:07:02.043573+0000","last_peered":"2024-03-19T06:07:02.043573+0000","last_clean":"2024-03-19T06:07:02.043573+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:07:02.043573+0000","last_undegraded":"2024-03-19T06:07:02.043573+0000","last_fullsized":"2024-03-19T06:07:02.043573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000236+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:07:02.000236+0000","last_peered":"2024-03-19T06:07:02.000236+0000","last_clean":"2024-03-19T06:07:02.000236+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:07:02.000236+0000","last_undegraded":"2024-03-19T06:07:02.000236+0000","last_fullsized":"2024-03-19T06:07:02.000236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.776946+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:07:24.776946+0000","last_peered":"2024-03-19T06:07:24.776946+0000","last_clean":"2024-03-19T06:07:24.776946+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:07:24.776946+0000","last_undegraded":"2024-03-19T06:07:24.776946+0000","last_fullsized":"2024-03-19T06:07:24.776946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000566+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:07:02.000566+0000","last_peered":"2024-03-19T06:07:02.000566+0000","last_clean":"2024-03-19T06:07:02.000566+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:07:02.000566+0000","last_undegraded":"2024-03-19T06:07:02.000566+0000","last_fullsized":"2024-03-19T06:07:02.000566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995704+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:07:01.995704+0000","last_peered":"2024-03-19T06:07:01.995704+0000","last_clean":"2024-03-19T06:07:01.995704+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:07:01.995704+0000","last_undegraded":"2024-03-19T06:07:01.995704+0000","last_fullsized":"2024-03-19T06:07:01.995704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154044+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:07:02.154044+0000","last_peered":"2024-03-19T06:07:02.154044+0000","last_clean":"2024-03-19T06:07:02.154044+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:07:02.154044+0000","last_undegraded":"2024-03-19T06:07:02.154044+0000","last_fullsized":"2024-03-19T06:07:02.154044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.998953+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:07:01.998953+0000","last_peered":"2024-03-19T06:07:01.998953+0000","last_clean":"2024-03-19T06:07:01.998953+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:07:01.998953+0000","last_undegraded":"2024-03-19T06:07:01.998953+0000","last_fullsized":"2024-03-19T06:07:01.998953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005904+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:07:02.005904+0000","last_peered":"2024-03-19T06:07:02.005904+0000","last_clean":"2024-03-19T06:07:02.005904+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:07:02.005904+0000","last_undegraded":"2024-03-19T06:07:02.005904+0000","last_fullsized":"2024-03-19T06:07:02.005904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043348+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:07:02.043348+0000","last_peered":"2024-03-19T06:07:02.043348+0000","last_clean":"2024-03-19T06:07:02.043348+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:07:02.043348+0000","last_undegraded":"2024-03-19T06:07:02.043348+0000","last_fullsized":"2024-03-19T06:07:02.043348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995602+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:07:01.995602+0000","last_peered":"2024-03-19T06:07:01.995602+0000","last_clean":"2024-03-19T06:07:01.995602+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:07:01.995602+0000","last_undegraded":"2024-03-19T06:07:01.995602+0000","last_fullsized":"2024-03-19T06:07:01.995602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004568+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:07:02.004568+0000","last_peered":"2024-03-19T06:07:02.004568+0000","last_clean":"2024-03-19T06:07:02.004568+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:07:02.004568+0000","last_undegraded":"2024-03-19T06:07:02.004568+0000","last_fullsized":"2024-03-19T06:07:02.004568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156237+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:07:02.156237+0000","last_peered":"2024-03-19T06:07:02.156237+0000","last_clean":"2024-03-19T06:07:02.156237+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:07:02.156237+0000","last_undegraded":"2024-03-19T06:07:02.156237+0000","last_fullsized":"2024-03-19T06:07:02.156237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997230+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:07:01.997230+0000","last_peered":"2024-03-19T06:07:01.997230+0000","last_clean":"2024-03-19T06:07:01.997230+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:07:01.997230+0000","last_undegraded":"2024-03-19T06:07:01.997230+0000","last_fullsized":"2024-03-19T06:07:01.997230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244587+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:07:02.244587+0000","last_peered":"2024-03-19T06:07:02.244587+0000","last_clean":"2024-03-19T06:07:02.244587+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:07:02.244587+0000","last_undegraded":"2024-03-19T06:07:02.244587+0000","last_fullsized":"2024-03-19T06:07:02.244587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993231+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:07:01.993231+0000","last_peered":"2024-03-19T06:07:01.993231+0000","last_clean":"2024-03-19T06:07:01.993231+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:07:01.993231+0000","last_undegraded":"2024-03-19T06:07:01.993231+0000","last_fullsized":"2024-03-19T06:07:01.993231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246075+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:07:02.246075+0000","last_peered":"2024-03-19T06:07:02.246075+0000","last_clean":"2024-03-19T06:07:02.246075+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:07:02.246075+0000","last_undegraded":"2024-03-19T06:07:02.246075+0000","last_fullsized":"2024-03-19T06:07:02.246075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042839+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:07:02.042839+0000","last_peered":"2024-03-19T06:07:02.042839+0000","last_clean":"2024-03-19T06:07:02.042839+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:07:02.042839+0000","last_undegraded":"2024-03-19T06:07:02.042839+0000","last_fullsized":"2024-03-19T06:07:02.042839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154779+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:07:02.154779+0000","last_peered":"2024-03-19T06:07:02.154779+0000","last_clean":"2024-03-19T06:07:02.154779+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:07:02.154779+0000","last_undegraded":"2024-03-19T06:07:02.154779+0000","last_fullsized":"2024-03-19T06:07:02.154779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242289+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:07:02.242289+0000","last_peered":"2024-03-19T06:07:02.242289+0000","last_clean":"2024-03-19T06:07:02.242289+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:07:02.242289+0000","last_undegraded":"2024-03-19T06:07:02.242289+0000","last_fullsized":"2024-03-19T06:07:02.242289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000126+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:07:02.000126+0000","last_peered":"2024-03-19T06:07:02.000126+0000","last_clean":"2024-03-19T06:07:02.000126+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:07:02.000126+0000","last_undegraded":"2024-03-19T06:07:02.000126+0000","last_fullsized":"2024-03-19T06:07:02.000126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247072+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:07:02.247072+0000","last_peered":"2024-03-19T06:07:02.247072+0000","last_clean":"2024-03-19T06:07:02.247072+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:07:02.247072+0000","last_undegraded":"2024-03-19T06:07:02.247072+0000","last_fullsized":"2024-03-19T06:07:02.247072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244557+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:07:02.244557+0000","last_peered":"2024-03-19T06:07:02.244557+0000","last_clean":"2024-03-19T06:07:02.244557+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:07:02.244557+0000","last_undegraded":"2024-03-19T06:07:02.244557+0000","last_fullsized":"2024-03-19T06:07:02.244557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001833+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:07:02.001833+0000","last_peered":"2024-03-19T06:07:02.001833+0000","last_clean":"2024-03-19T06:07:02.001833+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:07:02.001833+0000","last_undegraded":"2024-03-19T06:07:02.001833+0000","last_fullsized":"2024-03-19T06:07:02.001833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042647+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:07:02.042647+0000","last_peered":"2024-03-19T06:07:02.042647+0000","last_clean":"2024-03-19T06:07:02.042647+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:07:02.042647+0000","last_undegraded":"2024-03-19T06:07:02.042647+0000","last_fullsized":"2024-03-19T06:07:02.042647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.162102+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:07:02.162102+0000","last_peered":"2024-03-19T06:07:02.162102+0000","last_clean":"2024-03-19T06:07:02.162102+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:07:02.162102+0000","last_undegraded":"2024-03-19T06:07:02.162102+0000","last_fullsized":"2024-03-19T06:07:02.162102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001286+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:07:02.001286+0000","last_peered":"2024-03-19T06:07:02.001286+0000","last_clean":"2024-03-19T06:07:02.001286+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:07:02.001286+0000","last_undegraded":"2024-03-19T06:07:02.001286+0000","last_fullsized":"2024-03-19T06:07:02.001286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155928+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:07:02.155928+0000","last_peered":"2024-03-19T06:07:02.155928+0000","last_clean":"2024-03-19T06:07:02.155928+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:07:02.155928+0000","last_undegraded":"2024-03-19T06:07:02.155928+0000","last_fullsized":"2024-03-19T06:07:02.155928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156135+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:07:02.156135+0000","last_peered":"2024-03-19T06:07:02.156135+0000","last_clean":"2024-03-19T06:07:02.156135+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:07:02.156135+0000","last_undegraded":"2024-03-19T06:07:02.156135+0000","last_fullsized":"2024-03-19T06:07:02.156135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242863+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:07:02.242863+0000","last_peered":"2024-03-19T06:07:02.242863+0000","last_clean":"2024-03-19T06:07:02.242863+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:07:02.242863+0000","last_undegraded":"2024-03-19T06:07:02.242863+0000","last_fullsized":"2024-03-19T06:07:02.242863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993019+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:07:01.993019+0000","last_peered":"2024-03-19T06:07:01.993019+0000","last_clean":"2024-03-19T06:07:01.993019+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:07:01.993019+0000","last_undegraded":"2024-03-19T06:07:01.993019+0000","last_fullsized":"2024-03-19T06:07:01.993019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240899+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:07:02.240899+0000","last_peered":"2024-03-19T06:07:02.240899+0000","last_clean":"2024-03-19T06:07:02.240899+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:07:02.240899+0000","last_undegraded":"2024-03-19T06:07:02.240899+0000","last_fullsized":"2024-03-19T06:07:02.240899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.047146+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:07:02.047146+0000","last_peered":"2024-03-19T06:07:02.047146+0000","last_clean":"2024-03-19T06:07:02.047146+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:07:02.047146+0000","last_undegraded":"2024-03-19T06:07:02.047146+0000","last_fullsized":"2024-03-19T06:07:02.047146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241517+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:07:02.241517+0000","last_peered":"2024-03-19T06:07:02.241517+0000","last_clean":"2024-03-19T06:07:02.241517+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:07:02.241517+0000","last_undegraded":"2024-03-19T06:07:02.241517+0000","last_fullsized":"2024-03-19T06:07:02.241517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247855+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:07:02.247855+0000","last_peered":"2024-03-19T06:07:02.247855+0000","last_clean":"2024-03-19T06:07:02.247855+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:07:02.247855+0000","last_undegraded":"2024-03-19T06:07:02.247855+0000","last_fullsized":"2024-03-19T06:07:02.247855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043112+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:07:02.043112+0000","last_peered":"2024-03-19T06:07:02.043112+0000","last_clean":"2024-03-19T06:07:02.043112+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:07:02.043112+0000","last_undegraded":"2024-03-19T06:07:02.043112+0000","last_fullsized":"2024-03-19T06:07:02.043112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005165+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:07:02.005165+0000","last_peered":"2024-03-19T06:07:02.005165+0000","last_clean":"2024-03-19T06:07:02.005165+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:07:02.005165+0000","last_undegraded":"2024-03-19T06:07:02.005165+0000","last_fullsized":"2024-03-19T06:07:02.005165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.161673+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:07:02.161673+0000","last_peered":"2024-03-19T06:07:02.161673+0000","last_clean":"2024-03-19T06:07:02.161673+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:07:02.161673+0000","last_undegraded":"2024-03-19T06:07:02.161673+0000","last_fullsized":"2024-03-19T06:07:02.161673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476757,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":733283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476756,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":142361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":141725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":146063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":145531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":141599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":142431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":950272,"data_stored":732627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:07:30.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:07:30.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.501+0000 7fc3af200640 1 Processor -- start 2024-03-19T06:07:30.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.501+0000 7fc3af200640 1 -- start start 2024-03-19T06:07:30.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3af200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 0x7fc3b015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3af200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3b015dc60 0x7fc3b00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3af200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b015a200 con 0x7fc3b00c9410 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3af200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b015e0f0 con 0x7fc3b015dc60 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3af200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00caac0 con 0x7fc3b0159c10 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3ade00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc3b00c9410 0x7fc3b00ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60302/0 (socket says 172.21.15.17:60302) 2024-03-19T06:07:30.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.503+0000 7fc3ade00640 1 -- 172.21.15.17:0/1206853165 learned_addr learned my addr 172.21.15.17:0/1206853165 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:30.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.504+0000 7fc3ae800640 1 --2- 172.21.15.17:0/1206853165 >> v2:172.21.15.153:3300/0 conn(0x7fc3b015dc60 0x7fc3b00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.505+0000 7fc3a7e00640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 0x7fc3b015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.507+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878288090 0 0) 0x7fc3b015a200 con 0x7fc3b00c9410 2024-03-19T06:07:30.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.507+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc394003520 con 0x7fc3b00c9410 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790507733 0 0) 0x7fc394003520 con 0x7fc3b00c9410 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 msgr2=0x7fc3b015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 0x7fc3b015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 >> v2:172.21.15.153:3300/0 conn(0x7fc3b015dc60 msgr2=0x7fc3b00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 --2- 172.21.15.17:0/1206853165 >> v2:172.21.15.153:3300/0 conn(0x7fc3b015dc60 0x7fc3b00caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b015a4c0 con 0x7fc3b00c9410 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fc3a0001670 con 0x7fc3b00c9410 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 >> v1:172.21.15.17:6789/0 conn(0x7fc3b00c9410 legacy=0x7fc3b00ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc394003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 0x7fc394004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc394004d40 0x7fc3940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b00caac0 con 0x7fc3940039e0 2024-03-19T06:07:30.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400b9c0 con 0x7fc394004d40 2024-03-19T06:07:30.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.511+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39400bb40 con 0x7fc3b0159c10 2024-03-19T06:07:30.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.516+0000 7fc3ade00640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc394003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.519+0000 7fc3ade00640 1 -- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 msgr2=0x7fc394004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.519+0000 7fc3ade00640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b0159c10 0x7fc394004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.519+0000 7fc3ade00640 1 -- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc394004d40 msgr2=0x7fc3940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.519+0000 7fc3ade00640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc394004d40 0x7fc3940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.519+0000 7fc3ade00640 1 -- 172.21.15.17:0/1206853165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394003520 con 0x7fc3940039e0 2024-03-19T06:07:30.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.522+0000 7fc3ade00640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc394003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c190 tx=0x7fc394005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae352a55901540b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.525+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007c40 con 0x7fc3940039e0 2024-03-19T06:07:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.525+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0030070 con 0x7fc3940039e0 2024-03-19T06:07:30.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.525+0000 7fc3ad400640 1 -- 172.21.15.17:0/1206853165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0005db0 con 0x7fc3940039e0 2024-03-19T06:07:30.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 -- 172.21.15.17:0/1206853165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 msgr2=0x7fc394003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 --2- 172.21.15.17:0/1206853165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc394003e00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c190 tx=0x7fc394005830 comp rx=0 tx=0).stop 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3ae800640 1 -- 172.21.15.17:0/1206853165 reap_dead start 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 -- 172.21.15.17:0/1206853165 shutdown_connections 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 -- 172.21.15.17:0/1206853165 >> 172.21.15.17:0/1206853165 conn(0x7fc3b0072360 msgr2=0x7fc3b0072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 -- 172.21.15.17:0/1206853165 shutdown_connections 2024-03-19T06:07:30.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.527+0000 7fc3af200640 1 -- 172.21.15.17:0/1206853165 wait complete. 2024-03-19T06:07:30.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.529+0000 7fc3af200640 1 Processor -- start 2024-03-19T06:07:30.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.529+0000 7fc3af200640 1 -- start start 2024-03-19T06:07:30.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b006b900 0x7fc3b01f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b01f3220 0x7fc3b014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015d180 con 0x7fc3940039e0 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015aa80 con 0x7fc3b006b900 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3af200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b015d460 con 0x7fc3b01f3220 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3ade00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47236/0 (socket says 172.21.15.17:47236) 2024-03-19T06:07:30.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3ade00640 1 -- 172.21.15.17:0/2299332126 learned_addr learned my addr 172.21.15.17:0/2299332126 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.531+0000 7fc3ae800640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b01f3220 0x7fc3b014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.532+0000 7fc3a7e00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b006b900 0x7fc3b01f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.536+0000 7fc3ade00640 1 -- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b01f3220 msgr2=0x7fc3b014d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.536+0000 7fc3ade00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b01f3220 0x7fc3b014d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.536+0000 7fc3ade00640 1 -- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b006b900 msgr2=0x7fc3b01f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.536+0000 7fc3ade00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b006b900 0x7fc3b01f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:30.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.536+0000 7fc3ade00640 1 -- 172.21.15.17:0/2299332126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b01f36a0 con 0x7fc3940039e0 2024-03-19T06:07:30.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.538+0000 7fc3ade00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c2b0 tx=0x7fc3b00c67e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:30.534 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-03-19T06:07:30.539+0000 f5ec640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-19T06:07:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.543+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0007c40 con 0x7fc3940039e0 2024-03-19T06:07:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.543+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a002de40 con 0x7fc3940039e0 2024-03-19T06:07:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.543+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0004bf0 con 0x7fc3940039e0 2024-03-19T06:07:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.543+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b00c6ab0 con 0x7fc3940039e0 2024-03-19T06:07:30.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.543+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b00c3070 con 0x7fc3940039e0 2024-03-19T06:07:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.544+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00b4620 con 0x7fc3940039e0 2024-03-19T06:07:30.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.852+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc3a0007070 con 0x7fc3940039e0 2024-03-19T06:07:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.854+0000 7fc3a6000640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 0x7fc38c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:30.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.855+0000 7fc3a7e00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 0x7fc38c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:30.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.856+0000 7fc3a7e00640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 0x7fc38c06e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00c27b0 tx=0x7fc3980094a0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.882+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc3a0078820 con 0x7fc3940039e0 2024-03-19T06:07:30.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:30.882+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc3b00b4620 con 0x7fc3940039e0 2024-03-19T06:07:31.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.091+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3b004f050 con 0x7fc38c06bc20 2024-03-19T06:07:31.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.101+0000 7fc3a6000640 1 -- 172.21.15.17:0/2299332126 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332694 (secure 0 0 0) 0x7fc3b004f050 con 0x7fc38c06bc20 2024-03-19T06:07:31.097 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:07:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 msgr2=0x7fc38c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 0x7fc38c06e0e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00c27b0 tx=0x7fc3980094a0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 msgr2=0x7fc3b00c49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000c2b0 tx=0x7fc3b00c67e0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 shutdown_connections 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc3b01f3220 0x7fc3b014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc38c06bc20 0x7fc38c06e0e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b006b900 0x7fc3b01f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 --2- 172.21.15.17:0/2299332126 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc3940039e0 0x7fc3b00c49c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 >> 172.21.15.17:0/2299332126 conn(0x7fc3b0072360 msgr2=0x7fc3b0072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 shutdown_connections 2024-03-19T06:07:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.109+0000 7fc3af200640 1 -- 172.21.15.17:0/2299332126 wait complete. 2024-03-19T06:07:31.125 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-19T06:07:29.319283+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":248,"num_write_kb":2448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236696,"kb_used_data":3928,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738024,"statfs":{"total":773094113280,"available":772851736576,"internally_reserved":0,"allocated":4022272,"data_stored":2325620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005666"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044220+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:07:02.044220+0000","last_peered":"2024-03-19T06:07:02.044220+0000","last_clean":"2024-03-19T06:07:02.044220+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:07:02.044220+0000","last_undegraded":"2024-03-19T06:07:02.044220+0000","last_fullsized":"2024-03-19T06:07:02.044220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996193+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:07:01.996193+0000","last_peered":"2024-03-19T06:07:01.996193+0000","last_clean":"2024-03-19T06:07:01.996193+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:07:01.996193+0000","last_undegraded":"2024-03-19T06:07:01.996193+0000","last_fullsized":"2024-03-19T06:07:01.996193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992725+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:07:01.992725+0000","last_peered":"2024-03-19T06:07:01.992725+0000","last_clean":"2024-03-19T06:07:01.992725+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:07:01.992725+0000","last_undegraded":"2024-03-19T06:07:01.992725+0000","last_fullsized":"2024-03-19T06:07:01.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996588+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:07:01.996588+0000","last_peered":"2024-03-19T06:07:01.996588+0000","last_clean":"2024-03-19T06:07:01.996588+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:07:01.996588+0000","last_undegraded":"2024-03-19T06:07:01.996588+0000","last_fullsized":"2024-03-19T06:07:01.996588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043882+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:07:02.043882+0000","last_peered":"2024-03-19T06:07:02.043882+0000","last_clean":"2024-03-19T06:07:02.043882+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:07:02.043882+0000","last_undegraded":"2024-03-19T06:07:02.043882+0000","last_fullsized":"2024-03-19T06:07:02.043882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999673+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:07:01.999673+0000","last_peered":"2024-03-19T06:07:01.999673+0000","last_clean":"2024-03-19T06:07:01.999673+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:07:01.999673+0000","last_undegraded":"2024-03-19T06:07:01.999673+0000","last_fullsized":"2024-03-19T06:07:01.999673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242144+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:07:02.242144+0000","last_peered":"2024-03-19T06:07:02.242144+0000","last_clean":"2024-03-19T06:07:02.242144+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:07:02.242144+0000","last_undegraded":"2024-03-19T06:07:02.242144+0000","last_fullsized":"2024-03-19T06:07:02.242144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247982+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:07:02.247982+0000","last_peered":"2024-03-19T06:07:02.247982+0000","last_clean":"2024-03-19T06:07:02.247982+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:07:02.247982+0000","last_undegraded":"2024-03-19T06:07:02.247982+0000","last_fullsized":"2024-03-19T06:07:02.247982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.159056+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:07:02.159056+0000","last_peered":"2024-03-19T06:07:02.159056+0000","last_clean":"2024-03-19T06:07:02.159056+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:07:02.159056+0000","last_undegraded":"2024-03-19T06:07:02.159056+0000","last_fullsized":"2024-03-19T06:07:02.159056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241176+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:07:02.241176+0000","last_peered":"2024-03-19T06:07:02.241176+0000","last_clean":"2024-03-19T06:07:02.241176+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:07:02.241176+0000","last_undegraded":"2024-03-19T06:07:02.241176+0000","last_fullsized":"2024-03-19T06:07:02.241176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247222+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:07:02.247222+0000","last_peered":"2024-03-19T06:07:02.247222+0000","last_clean":"2024-03-19T06:07:02.247222+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:07:02.247222+0000","last_undegraded":"2024-03-19T06:07:02.247222+0000","last_fullsized":"2024-03-19T06:07:02.247222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000220+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:07:02.000220+0000","last_peered":"2024-03-19T06:07:02.000220+0000","last_clean":"2024-03-19T06:07:02.000220+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:07:02.000220+0000","last_undegraded":"2024-03-19T06:07:02.000220+0000","last_fullsized":"2024-03-19T06:07:02.000220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154988+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:07:02.154988+0000","last_peered":"2024-03-19T06:07:02.154988+0000","last_clean":"2024-03-19T06:07:02.154988+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:07:02.154988+0000","last_undegraded":"2024-03-19T06:07:02.154988+0000","last_fullsized":"2024-03-19T06:07:02.154988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.566454+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:07:24.566454+0000","last_peered":"2024-03-19T06:07:24.566454+0000","last_clean":"2024-03-19T06:07:24.566454+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:07:24.566454+0000","last_undegraded":"2024-03-19T06:07:24.566454+0000","last_fullsized":"2024-03-19T06:07:24.566454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000701+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:07:02.000701+0000","last_peered":"2024-03-19T06:07:02.000701+0000","last_clean":"2024-03-19T06:07:02.000701+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:07:02.000701+0000","last_undegraded":"2024-03-19T06:07:02.000701+0000","last_fullsized":"2024-03-19T06:07:02.000701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.994372+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:07:01.994372+0000","last_peered":"2024-03-19T06:07:01.994372+0000","last_clean":"2024-03-19T06:07:01.994372+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:07:01.994372+0000","last_undegraded":"2024-03-19T06:07:01.994372+0000","last_fullsized":"2024-03-19T06:07:01.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004136+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:07:02.004136+0000","last_peered":"2024-03-19T06:07:02.004136+0000","last_clean":"2024-03-19T06:07:02.004136+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:07:02.004136+0000","last_undegraded":"2024-03-19T06:07:02.004136+0000","last_fullsized":"2024-03-19T06:07:02.004136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001560+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:07:02.001560+0000","last_peered":"2024-03-19T06:07:02.001560+0000","last_clean":"2024-03-19T06:07:02.001560+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:07:02.001560+0000","last_undegraded":"2024-03-19T06:07:02.001560+0000","last_fullsized":"2024-03-19T06:07:02.001560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993604+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:07:01.993604+0000","last_peered":"2024-03-19T06:07:01.993604+0000","last_clean":"2024-03-19T06:07:01.993604+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:07:01.993604+0000","last_undegraded":"2024-03-19T06:07:01.993604+0000","last_fullsized":"2024-03-19T06:07:01.993604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.569184+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:07:24.569184+0000","last_peered":"2024-03-19T06:07:24.569184+0000","last_clean":"2024-03-19T06:07:24.569184+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:07:24.569184+0000","last_undegraded":"2024-03-19T06:07:24.569184+0000","last_fullsized":"2024-03-19T06:07:24.569184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004757+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:07:02.004757+0000","last_peered":"2024-03-19T06:07:02.004757+0000","last_clean":"2024-03-19T06:07:02.004757+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:07:02.004757+0000","last_undegraded":"2024-03-19T06:07:02.004757+0000","last_fullsized":"2024-03-19T06:07:02.004757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000136+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:07:02.000136+0000","last_peered":"2024-03-19T06:07:02.000136+0000","last_clean":"2024-03-19T06:07:02.000136+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:07:02.000136+0000","last_undegraded":"2024-03-19T06:07:02.000136+0000","last_fullsized":"2024-03-19T06:07:02.000136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.567976+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:07:24.567976+0000","last_peered":"2024-03-19T06:07:24.567976+0000","last_clean":"2024-03-19T06:07:24.567976+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:07:24.567976+0000","last_undegraded":"2024-03-19T06:07:24.567976+0000","last_fullsized":"2024-03-19T06:07:24.567976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001003+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:07:02.001003+0000","last_peered":"2024-03-19T06:07:02.001003+0000","last_clean":"2024-03-19T06:07:02.001003+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:07:02.001003+0000","last_undegraded":"2024-03-19T06:07:02.001003+0000","last_fullsized":"2024-03-19T06:07:02.001003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043713+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:07:02.043713+0000","last_peered":"2024-03-19T06:07:02.043713+0000","last_clean":"2024-03-19T06:07:02.043713+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:07:02.043713+0000","last_undegraded":"2024-03-19T06:07:02.043713+0000","last_fullsized":"2024-03-19T06:07:02.043713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.549178+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:07:24.549178+0000","last_peered":"2024-03-19T06:07:24.549178+0000","last_clean":"2024-03-19T06:07:24.549178+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:07:24.549178+0000","last_undegraded":"2024-03-19T06:07:24.549178+0000","last_fullsized":"2024-03-19T06:07:24.549178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000323+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:07:02.000323+0000","last_peered":"2024-03-19T06:07:02.000323+0000","last_clean":"2024-03-19T06:07:02.000323+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:07:02.000323+0000","last_undegraded":"2024-03-19T06:07:02.000323+0000","last_fullsized":"2024-03-19T06:07:02.000323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997387+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:07:01.997387+0000","last_peered":"2024-03-19T06:07:01.997387+0000","last_clean":"2024-03-19T06:07:01.997387+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:07:01.997387+0000","last_undegraded":"2024-03-19T06:07:01.997387+0000","last_fullsized":"2024-03-19T06:07:01.997387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005594+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:07:02.005594+0000","last_peered":"2024-03-19T06:07:02.005594+0000","last_clean":"2024-03-19T06:07:02.005594+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:07:02.005594+0000","last_undegraded":"2024-03-19T06:07:02.005594+0000","last_fullsized":"2024-03-19T06:07:02.005594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246594+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:07:02.246594+0000","last_peered":"2024-03-19T06:07:02.246594+0000","last_clean":"2024-03-19T06:07:02.246594+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:07:02.246594+0000","last_undegraded":"2024-03-19T06:07:02.246594+0000","last_fullsized":"2024-03-19T06:07:02.246594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004937+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:07:02.004937+0000","last_peered":"2024-03-19T06:07:02.004937+0000","last_clean":"2024-03-19T06:07:02.004937+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:07:02.004937+0000","last_undegraded":"2024-03-19T06:07:02.004937+0000","last_fullsized":"2024-03-19T06:07:02.004937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242514+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:07:02.242514+0000","last_peered":"2024-03-19T06:07:02.242514+0000","last_clean":"2024-03-19T06:07:02.242514+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:07:02.242514+0000","last_undegraded":"2024-03-19T06:07:02.242514+0000","last_fullsized":"2024-03-19T06:07:02.242514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042542+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:07:02.042542+0000","last_peered":"2024-03-19T06:07:02.042542+0000","last_clean":"2024-03-19T06:07:02.042542+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:07:02.042542+0000","last_undegraded":"2024-03-19T06:07:02.042542+0000","last_fullsized":"2024-03-19T06:07:02.042542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247206+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:07:02.247206+0000","last_peered":"2024-03-19T06:07:02.247206+0000","last_clean":"2024-03-19T06:07:02.247206+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:07:02.247206+0000","last_undegraded":"2024-03-19T06:07:02.247206+0000","last_fullsized":"2024-03-19T06:07:02.247206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005335+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:07:02.005335+0000","last_peered":"2024-03-19T06:07:02.005335+0000","last_clean":"2024-03-19T06:07:02.005335+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:07:02.005335+0000","last_undegraded":"2024-03-19T06:07:02.005335+0000","last_fullsized":"2024-03-19T06:07:02.005335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002045+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:07:02.002045+0000","last_peered":"2024-03-19T06:07:02.002045+0000","last_clean":"2024-03-19T06:07:02.002045+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:07:02.002045+0000","last_undegraded":"2024-03-19T06:07:02.002045+0000","last_fullsized":"2024-03-19T06:07:02.002045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002384+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:07:02.002384+0000","last_peered":"2024-03-19T06:07:02.002384+0000","last_clean":"2024-03-19T06:07:02.002384+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:07:02.002384+0000","last_undegraded":"2024-03-19T06:07:02.002384+0000","last_fullsized":"2024-03-19T06:07:02.002384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246683+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:07:02.246683+0000","last_peered":"2024-03-19T06:07:02.246683+0000","last_clean":"2024-03-19T06:07:02.246683+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:07:02.246683+0000","last_undegraded":"2024-03-19T06:07:02.246683+0000","last_fullsized":"2024-03-19T06:07:02.246683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004767+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:07:02.004767+0000","last_peered":"2024-03-19T06:07:02.004767+0000","last_clean":"2024-03-19T06:07:02.004767+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:07:02.004767+0000","last_undegraded":"2024-03-19T06:07:02.004767+0000","last_fullsized":"2024-03-19T06:07:02.004767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002256+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:07:02.002256+0000","last_peered":"2024-03-19T06:07:02.002256+0000","last_clean":"2024-03-19T06:07:02.002256+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:07:02.002256+0000","last_undegraded":"2024-03-19T06:07:02.002256+0000","last_fullsized":"2024-03-19T06:07:02.002256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999231+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:07:01.999231+0000","last_peered":"2024-03-19T06:07:01.999231+0000","last_clean":"2024-03-19T06:07:01.999231+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:07:01.999231+0000","last_undegraded":"2024-03-19T06:07:01.999231+0000","last_fullsized":"2024-03-19T06:07:01.999231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004938+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:07:02.004938+0000","last_peered":"2024-03-19T06:07:02.004938+0000","last_clean":"2024-03-19T06:07:02.004938+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:07:02.004938+0000","last_undegraded":"2024-03-19T06:07:02.004938+0000","last_fullsized":"2024-03-19T06:07:02.004938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042134+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:07:02.042134+0000","last_peered":"2024-03-19T06:07:02.042134+0000","last_clean":"2024-03-19T06:07:02.042134+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:07:02.042134+0000","last_undegraded":"2024-03-19T06:07:02.042134+0000","last_fullsized":"2024-03-19T06:07:02.042134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240780+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:07:02.240780+0000","last_peered":"2024-03-19T06:07:02.240780+0000","last_clean":"2024-03-19T06:07:02.240780+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:07:02.240780+0000","last_undegraded":"2024-03-19T06:07:02.240780+0000","last_fullsized":"2024-03-19T06:07:02.240780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043281+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:07:02.043281+0000","last_peered":"2024-03-19T06:07:02.043281+0000","last_clean":"2024-03-19T06:07:02.043281+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:07:02.043281+0000","last_undegraded":"2024-03-19T06:07:02.043281+0000","last_fullsized":"2024-03-19T06:07:02.043281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993253+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:07:01.993253+0000","last_peered":"2024-03-19T06:07:01.993253+0000","last_clean":"2024-03-19T06:07:01.993253+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:07:01.993253+0000","last_undegraded":"2024-03-19T06:07:01.993253+0000","last_fullsized":"2024-03-19T06:07:01.993253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.562622+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:07:24.562622+0000","last_peered":"2024-03-19T06:07:24.562622+0000","last_clean":"2024-03-19T06:07:24.562622+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:07:24.562622+0000","last_undegraded":"2024-03-19T06:07:24.562622+0000","last_fullsized":"2024-03-19T06:07:24.562622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240669+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:07:02.240669+0000","last_peered":"2024-03-19T06:07:02.240669+0000","last_clean":"2024-03-19T06:07:02.240669+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:07:02.240669+0000","last_undegraded":"2024-03-19T06:07:02.240669+0000","last_fullsized":"2024-03-19T06:07:02.240669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155726+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:07:02.155726+0000","last_peered":"2024-03-19T06:07:02.155726+0000","last_clean":"2024-03-19T06:07:02.155726+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:07:02.155726+0000","last_undegraded":"2024-03-19T06:07:02.155726+0000","last_fullsized":"2024-03-19T06:07:02.155726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241852+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:07:02.241852+0000","last_peered":"2024-03-19T06:07:02.241852+0000","last_clean":"2024-03-19T06:07:02.241852+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:07:02.241852+0000","last_undegraded":"2024-03-19T06:07:02.241852+0000","last_fullsized":"2024-03-19T06:07:02.241852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999771+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:07:01.999771+0000","last_peered":"2024-03-19T06:07:01.999771+0000","last_clean":"2024-03-19T06:07:01.999771+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:07:01.999771+0000","last_undegraded":"2024-03-19T06:07:01.999771+0000","last_fullsized":"2024-03-19T06:07:01.999771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154712+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:07:02.154712+0000","last_peered":"2024-03-19T06:07:02.154712+0000","last_clean":"2024-03-19T06:07:02.154712+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:07:02.154712+0000","last_undegraded":"2024-03-19T06:07:02.154712+0000","last_fullsized":"2024-03-19T06:07:02.154712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.248178+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:07:02.248178+0000","last_peered":"2024-03-19T06:07:02.248178+0000","last_clean":"2024-03-19T06:07:02.248178+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:07:02.248178+0000","last_undegraded":"2024-03-19T06:07:02.248178+0000","last_fullsized":"2024-03-19T06:07:02.248178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005203+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:07:02.005203+0000","last_peered":"2024-03-19T06:07:02.005203+0000","last_clean":"2024-03-19T06:07:02.005203+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:07:02.005203+0000","last_undegraded":"2024-03-19T06:07:02.005203+0000","last_fullsized":"2024-03-19T06:07:02.005203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043106+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:07:02.043106+0000","last_peered":"2024-03-19T06:07:02.043106+0000","last_clean":"2024-03-19T06:07:02.043106+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:07:02.043106+0000","last_undegraded":"2024-03-19T06:07:02.043106+0000","last_fullsized":"2024-03-19T06:07:02.043106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242959+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:07:02.242959+0000","last_peered":"2024-03-19T06:07:02.242959+0000","last_clean":"2024-03-19T06:07:02.242959+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:07:02.242959+0000","last_undegraded":"2024-03-19T06:07:02.242959+0000","last_fullsized":"2024-03-19T06:07:02.242959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000308+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:07:02.000308+0000","last_peered":"2024-03-19T06:07:02.000308+0000","last_clean":"2024-03-19T06:07:02.000308+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:07:02.000308+0000","last_undegraded":"2024-03-19T06:07:02.000308+0000","last_fullsized":"2024-03-19T06:07:02.000308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244381+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:07:02.244381+0000","last_peered":"2024-03-19T06:07:02.244381+0000","last_clean":"2024-03-19T06:07:02.244381+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:07:02.244381+0000","last_undegraded":"2024-03-19T06:07:02.244381+0000","last_fullsized":"2024-03-19T06:07:02.244381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242409+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:07:02.242409+0000","last_peered":"2024-03-19T06:07:02.242409+0000","last_clean":"2024-03-19T06:07:02.242409+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:07:02.242409+0000","last_undegraded":"2024-03-19T06:07:02.242409+0000","last_fullsized":"2024-03-19T06:07:02.242409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001851+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:07:02.001851+0000","last_peered":"2024-03-19T06:07:02.001851+0000","last_clean":"2024-03-19T06:07:02.001851+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:07:02.001851+0000","last_undegraded":"2024-03-19T06:07:02.001851+0000","last_fullsized":"2024-03-19T06:07:02.001851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999778+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:07:01.999778+0000","last_peered":"2024-03-19T06:07:01.999778+0000","last_clean":"2024-03-19T06:07:01.999778+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:07:01.999778+0000","last_undegraded":"2024-03-19T06:07:01.999778+0000","last_fullsized":"2024-03-19T06:07:01.999778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240955+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:07:02.240955+0000","last_peered":"2024-03-19T06:07:02.240955+0000","last_clean":"2024-03-19T06:07:02.240955+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:07:02.240955+0000","last_undegraded":"2024-03-19T06:07:02.240955+0000","last_fullsized":"2024-03-19T06:07:02.240955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561648+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:07:24.561648+0000","last_peered":"2024-03-19T06:07:24.561648+0000","last_clean":"2024-03-19T06:07:24.561648+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:07:24.561648+0000","last_undegraded":"2024-03-19T06:07:24.561648+0000","last_fullsized":"2024-03-19T06:07:24.561648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043013+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:07:02.043013+0000","last_peered":"2024-03-19T06:07:02.043013+0000","last_clean":"2024-03-19T06:07:02.043013+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:07:02.043013+0000","last_undegraded":"2024-03-19T06:07:02.043013+0000","last_fullsized":"2024-03-19T06:07:02.043013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154227+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:07:02.154227+0000","last_peered":"2024-03-19T06:07:02.154227+0000","last_clean":"2024-03-19T06:07:02.154227+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:07:02.154227+0000","last_undegraded":"2024-03-19T06:07:02.154227+0000","last_fullsized":"2024-03-19T06:07:02.154227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155019+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:07:02.155019+0000","last_peered":"2024-03-19T06:07:02.155019+0000","last_clean":"2024-03-19T06:07:02.155019+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:07:02.155019+0000","last_undegraded":"2024-03-19T06:07:02.155019+0000","last_fullsized":"2024-03-19T06:07:02.155019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997053+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:07:01.997053+0000","last_peered":"2024-03-19T06:07:01.997053+0000","last_clean":"2024-03-19T06:07:01.997053+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:07:01.997053+0000","last_undegraded":"2024-03-19T06:07:01.997053+0000","last_fullsized":"2024-03-19T06:07:01.997053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242714+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:07:02.242714+0000","last_peered":"2024-03-19T06:07:02.242714+0000","last_clean":"2024-03-19T06:07:02.242714+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:07:02.242714+0000","last_undegraded":"2024-03-19T06:07:02.242714+0000","last_fullsized":"2024-03-19T06:07:02.242714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561680+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:07:24.561680+0000","last_peered":"2024-03-19T06:07:24.561680+0000","last_clean":"2024-03-19T06:07:24.561680+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:07:24.561680+0000","last_undegraded":"2024-03-19T06:07:24.561680+0000","last_fullsized":"2024-03-19T06:07:24.561680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.251618+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:07:02.251618+0000","last_peered":"2024-03-19T06:07:02.251618+0000","last_clean":"2024-03-19T06:07:02.251618+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:07:02.251618+0000","last_undegraded":"2024-03-19T06:07:02.251618+0000","last_fullsized":"2024-03-19T06:07:02.251618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042759+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:07:02.042759+0000","last_peered":"2024-03-19T06:07:02.042759+0000","last_clean":"2024-03-19T06:07:02.042759+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:07:02.042759+0000","last_undegraded":"2024-03-19T06:07:02.042759+0000","last_fullsized":"2024-03-19T06:07:02.042759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.809230+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:07:24.809230+0000","last_peered":"2024-03-19T06:07:24.809230+0000","last_clean":"2024-03-19T06:07:24.809230+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:07:24.809230+0000","last_undegraded":"2024-03-19T06:07:24.809230+0000","last_fullsized":"2024-03-19T06:07:24.809230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246888+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:07:02.246888+0000","last_peered":"2024-03-19T06:07:02.246888+0000","last_clean":"2024-03-19T06:07:02.246888+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:07:02.246888+0000","last_undegraded":"2024-03-19T06:07:02.246888+0000","last_fullsized":"2024-03-19T06:07:02.246888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241798+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:07:02.241798+0000","last_peered":"2024-03-19T06:07:02.241798+0000","last_clean":"2024-03-19T06:07:02.241798+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:07:02.241798+0000","last_undegraded":"2024-03-19T06:07:02.241798+0000","last_fullsized":"2024-03-19T06:07:02.241798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.546487+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:07:24.546487+0000","last_peered":"2024-03-19T06:07:24.546487+0000","last_clean":"2024-03-19T06:07:24.546487+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:07:24.546487+0000","last_undegraded":"2024-03-19T06:07:24.546487+0000","last_fullsized":"2024-03-19T06:07:24.546487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002159+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:07:02.002159+0000","last_peered":"2024-03-19T06:07:02.002159+0000","last_clean":"2024-03-19T06:07:02.002159+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:07:02.002159+0000","last_undegraded":"2024-03-19T06:07:02.002159+0000","last_fullsized":"2024-03-19T06:07:02.002159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001301+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:07:02.001301+0000","last_peered":"2024-03-19T06:07:02.001301+0000","last_clean":"2024-03-19T06:07:02.001301+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:07:02.001301+0000","last_undegraded":"2024-03-19T06:07:02.001301+0000","last_fullsized":"2024-03-19T06:07:02.001301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005101+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:07:02.005101+0000","last_peered":"2024-03-19T06:07:02.005101+0000","last_clean":"2024-03-19T06:07:02.005101+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:07:02.005101+0000","last_undegraded":"2024-03-19T06:07:02.005101+0000","last_fullsized":"2024-03-19T06:07:02.005101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002617+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:07:02.002617+0000","last_peered":"2024-03-19T06:07:02.002617+0000","last_clean":"2024-03-19T06:07:02.002617+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:07:02.002617+0000","last_undegraded":"2024-03-19T06:07:02.002617+0000","last_fullsized":"2024-03-19T06:07:02.002617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044065+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:07:02.044065+0000","last_peered":"2024-03-19T06:07:02.044065+0000","last_clean":"2024-03-19T06:07:02.044065+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:07:02.044065+0000","last_undegraded":"2024-03-19T06:07:02.044065+0000","last_fullsized":"2024-03-19T06:07:02.044065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.560919+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:07:24.560919+0000","last_peered":"2024-03-19T06:07:24.560919+0000","last_clean":"2024-03-19T06:07:24.560919+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:07:24.560919+0000","last_undegraded":"2024-03-19T06:07:24.560919+0000","last_fullsized":"2024-03-19T06:07:24.560919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993250+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:07:01.993250+0000","last_peered":"2024-03-19T06:07:01.993250+0000","last_clean":"2024-03-19T06:07:01.993250+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:07:01.993250+0000","last_undegraded":"2024-03-19T06:07:01.993250+0000","last_fullsized":"2024-03-19T06:07:01.993250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247142+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:07:02.247142+0000","last_peered":"2024-03-19T06:07:02.247142+0000","last_clean":"2024-03-19T06:07:02.247142+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:07:02.247142+0000","last_undegraded":"2024-03-19T06:07:02.247142+0000","last_fullsized":"2024-03-19T06:07:02.247142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.551476+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:07:24.551476+0000","last_peered":"2024-03-19T06:07:24.551476+0000","last_clean":"2024-03-19T06:07:24.551476+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:07:24.551476+0000","last_undegraded":"2024-03-19T06:07:24.551476+0000","last_fullsized":"2024-03-19T06:07:24.551476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992913+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:07:01.992913+0000","last_peered":"2024-03-19T06:07:01.992913+0000","last_clean":"2024-03-19T06:07:01.992913+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:07:01.992913+0000","last_undegraded":"2024-03-19T06:07:01.992913+0000","last_fullsized":"2024-03-19T06:07:01.992913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042627+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:07:02.042627+0000","last_peered":"2024-03-19T06:07:02.042627+0000","last_clean":"2024-03-19T06:07:02.042627+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:07:02.042627+0000","last_undegraded":"2024-03-19T06:07:02.042627+0000","last_fullsized":"2024-03-19T06:07:02.042627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001706+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:07:02.001706+0000","last_peered":"2024-03-19T06:07:02.001706+0000","last_clean":"2024-03-19T06:07:02.001706+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:07:02.001706+0000","last_undegraded":"2024-03-19T06:07:02.001706+0000","last_fullsized":"2024-03-19T06:07:02.001706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246483+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:07:02.246483+0000","last_peered":"2024-03-19T06:07:02.246483+0000","last_clean":"2024-03-19T06:07:02.246483+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:07:02.246483+0000","last_undegraded":"2024-03-19T06:07:02.246483+0000","last_fullsized":"2024-03-19T06:07:02.246483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156234+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:07:02.156234+0000","last_peered":"2024-03-19T06:07:02.156234+0000","last_clean":"2024-03-19T06:07:02.156234+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:07:02.156234+0000","last_undegraded":"2024-03-19T06:07:02.156234+0000","last_fullsized":"2024-03-19T06:07:02.156234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993429+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:07:01.993429+0000","last_peered":"2024-03-19T06:07:01.993429+0000","last_clean":"2024-03-19T06:07:01.993429+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:07:01.993429+0000","last_undegraded":"2024-03-19T06:07:01.993429+0000","last_fullsized":"2024-03-19T06:07:01.993429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993527+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:07:01.993527+0000","last_peered":"2024-03-19T06:07:01.993527+0000","last_clean":"2024-03-19T06:07:01.993527+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:07:01.993527+0000","last_undegraded":"2024-03-19T06:07:01.993527+0000","last_fullsized":"2024-03-19T06:07:01.993527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155399+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:07:02.155399+0000","last_peered":"2024-03-19T06:07:02.155399+0000","last_clean":"2024-03-19T06:07:02.155399+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:07:02.155399+0000","last_undegraded":"2024-03-19T06:07:02.155399+0000","last_fullsized":"2024-03-19T06:07:02.155399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043573+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:07:02.043573+0000","last_peered":"2024-03-19T06:07:02.043573+0000","last_clean":"2024-03-19T06:07:02.043573+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:07:02.043573+0000","last_undegraded":"2024-03-19T06:07:02.043573+0000","last_fullsized":"2024-03-19T06:07:02.043573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000236+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:07:02.000236+0000","last_peered":"2024-03-19T06:07:02.000236+0000","last_clean":"2024-03-19T06:07:02.000236+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:07:02.000236+0000","last_undegraded":"2024-03-19T06:07:02.000236+0000","last_fullsized":"2024-03-19T06:07:02.000236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.776946+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:07:24.776946+0000","last_peered":"2024-03-19T06:07:24.776946+0000","last_clean":"2024-03-19T06:07:24.776946+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:07:24.776946+0000","last_undegraded":"2024-03-19T06:07:24.776946+0000","last_fullsized":"2024-03-19T06:07:24.776946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000566+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:07:02.000566+0000","last_peered":"2024-03-19T06:07:02.000566+0000","last_clean":"2024-03-19T06:07:02.000566+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:07:02.000566+0000","last_undegraded":"2024-03-19T06:07:02.000566+0000","last_fullsized":"2024-03-19T06:07:02.000566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995704+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:07:01.995704+0000","last_peered":"2024-03-19T06:07:01.995704+0000","last_clean":"2024-03-19T06:07:01.995704+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:07:01.995704+0000","last_undegraded":"2024-03-19T06:07:01.995704+0000","last_fullsized":"2024-03-19T06:07:01.995704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154044+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:07:02.154044+0000","last_peered":"2024-03-19T06:07:02.154044+0000","last_clean":"2024-03-19T06:07:02.154044+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:07:02.154044+0000","last_undegraded":"2024-03-19T06:07:02.154044+0000","last_fullsized":"2024-03-19T06:07:02.154044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.998953+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:07:01.998953+0000","last_peered":"2024-03-19T06:07:01.998953+0000","last_clean":"2024-03-19T06:07:01.998953+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:07:01.998953+0000","last_undegraded":"2024-03-19T06:07:01.998953+0000","last_fullsized":"2024-03-19T06:07:01.998953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005904+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:07:02.005904+0000","last_peered":"2024-03-19T06:07:02.005904+0000","last_clean":"2024-03-19T06:07:02.005904+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:07:02.005904+0000","last_undegraded":"2024-03-19T06:07:02.005904+0000","last_fullsized":"2024-03-19T06:07:02.005904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043348+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:07:02.043348+0000","last_peered":"2024-03-19T06:07:02.043348+0000","last_clean":"2024-03-19T06:07:02.043348+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:07:02.043348+0000","last_undegraded":"2024-03-19T06:07:02.043348+0000","last_fullsized":"2024-03-19T06:07:02.043348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995602+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:07:01.995602+0000","last_peered":"2024-03-19T06:07:01.995602+0000","last_clean":"2024-03-19T06:07:01.995602+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:07:01.995602+0000","last_undegraded":"2024-03-19T06:07:01.995602+0000","last_fullsized":"2024-03-19T06:07:01.995602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004568+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:07:02.004568+0000","last_peered":"2024-03-19T06:07:02.004568+0000","last_clean":"2024-03-19T06:07:02.004568+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:07:02.004568+0000","last_undegraded":"2024-03-19T06:07:02.004568+0000","last_fullsized":"2024-03-19T06:07:02.004568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156237+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:07:02.156237+0000","last_peered":"2024-03-19T06:07:02.156237+0000","last_clean":"2024-03-19T06:07:02.156237+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:07:02.156237+0000","last_undegraded":"2024-03-19T06:07:02.156237+0000","last_fullsized":"2024-03-19T06:07:02.156237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997230+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:07:01.997230+0000","last_peered":"2024-03-19T06:07:01.997230+0000","last_clean":"2024-03-19T06:07:01.997230+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:07:01.997230+0000","last_undegraded":"2024-03-19T06:07:01.997230+0000","last_fullsized":"2024-03-19T06:07:01.997230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244587+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:07:02.244587+0000","last_peered":"2024-03-19T06:07:02.244587+0000","last_clean":"2024-03-19T06:07:02.244587+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:07:02.244587+0000","last_undegraded":"2024-03-19T06:07:02.244587+0000","last_fullsized":"2024-03-19T06:07:02.244587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993231+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:07:01.993231+0000","last_peered":"2024-03-19T06:07:01.993231+0000","last_clean":"2024-03-19T06:07:01.993231+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:07:01.993231+0000","last_undegraded":"2024-03-19T06:07:01.993231+0000","last_fullsized":"2024-03-19T06:07:01.993231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246075+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:07:02.246075+0000","last_peered":"2024-03-19T06:07:02.246075+0000","last_clean":"2024-03-19T06:07:02.246075+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:07:02.246075+0000","last_undegraded":"2024-03-19T06:07:02.246075+0000","last_fullsized":"2024-03-19T06:07:02.246075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042839+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:07:02.042839+0000","last_peered":"2024-03-19T06:07:02.042839+0000","last_clean":"2024-03-19T06:07:02.042839+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:07:02.042839+0000","last_undegraded":"2024-03-19T06:07:02.042839+0000","last_fullsized":"2024-03-19T06:07:02.042839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154779+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:07:02.154779+0000","last_peered":"2024-03-19T06:07:02.154779+0000","last_clean":"2024-03-19T06:07:02.154779+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:07:02.154779+0000","last_undegraded":"2024-03-19T06:07:02.154779+0000","last_fullsized":"2024-03-19T06:07:02.154779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242289+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:07:02.242289+0000","last_peered":"2024-03-19T06:07:02.242289+0000","last_clean":"2024-03-19T06:07:02.242289+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:07:02.242289+0000","last_undegraded":"2024-03-19T06:07:02.242289+0000","last_fullsized":"2024-03-19T06:07:02.242289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000126+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:07:02.000126+0000","last_peered":"2024-03-19T06:07:02.000126+0000","last_clean":"2024-03-19T06:07:02.000126+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:07:02.000126+0000","last_undegraded":"2024-03-19T06:07:02.000126+0000","last_fullsized":"2024-03-19T06:07:02.000126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247072+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:07:02.247072+0000","last_peered":"2024-03-19T06:07:02.247072+0000","last_clean":"2024-03-19T06:07:02.247072+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:07:02.247072+0000","last_undegraded":"2024-03-19T06:07:02.247072+0000","last_fullsized":"2024-03-19T06:07:02.247072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244557+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:07:02.244557+0000","last_peered":"2024-03-19T06:07:02.244557+0000","last_clean":"2024-03-19T06:07:02.244557+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:07:02.244557+0000","last_undegraded":"2024-03-19T06:07:02.244557+0000","last_fullsized":"2024-03-19T06:07:02.244557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001833+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:07:02.001833+0000","last_peered":"2024-03-19T06:07:02.001833+0000","last_clean":"2024-03-19T06:07:02.001833+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:07:02.001833+0000","last_undegraded":"2024-03-19T06:07:02.001833+0000","last_fullsized":"2024-03-19T06:07:02.001833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042647+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:07:02.042647+0000","last_peered":"2024-03-19T06:07:02.042647+0000","last_clean":"2024-03-19T06:07:02.042647+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:07:02.042647+0000","last_undegraded":"2024-03-19T06:07:02.042647+0000","last_fullsized":"2024-03-19T06:07:02.042647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.162102+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:07:02.162102+0000","last_peered":"2024-03-19T06:07:02.162102+0000","last_clean":"2024-03-19T06:07:02.162102+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:07:02.162102+0000","last_undegraded":"2024-03-19T06:07:02.162102+0000","last_fullsized":"2024-03-19T06:07:02.162102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001286+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:07:02.001286+0000","last_peered":"2024-03-19T06:07:02.001286+0000","last_clean":"2024-03-19T06:07:02.001286+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:07:02.001286+0000","last_undegraded":"2024-03-19T06:07:02.001286+0000","last_fullsized":"2024-03-19T06:07:02.001286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155928+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:07:02.155928+0000","last_peered":"2024-03-19T06:07:02.155928+0000","last_clean":"2024-03-19T06:07:02.155928+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:07:02.155928+0000","last_undegraded":"2024-03-19T06:07:02.155928+0000","last_fullsized":"2024-03-19T06:07:02.155928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156135+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:07:02.156135+0000","last_peered":"2024-03-19T06:07:02.156135+0000","last_clean":"2024-03-19T06:07:02.156135+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:07:02.156135+0000","last_undegraded":"2024-03-19T06:07:02.156135+0000","last_fullsized":"2024-03-19T06:07:02.156135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242863+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:07:02.242863+0000","last_peered":"2024-03-19T06:07:02.242863+0000","last_clean":"2024-03-19T06:07:02.242863+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:07:02.242863+0000","last_undegraded":"2024-03-19T06:07:02.242863+0000","last_fullsized":"2024-03-19T06:07:02.242863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993019+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:07:01.993019+0000","last_peered":"2024-03-19T06:07:01.993019+0000","last_clean":"2024-03-19T06:07:01.993019+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:07:01.993019+0000","last_undegraded":"2024-03-19T06:07:01.993019+0000","last_fullsized":"2024-03-19T06:07:01.993019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240899+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:07:02.240899+0000","last_peered":"2024-03-19T06:07:02.240899+0000","last_clean":"2024-03-19T06:07:02.240899+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:07:02.240899+0000","last_undegraded":"2024-03-19T06:07:02.240899+0000","last_fullsized":"2024-03-19T06:07:02.240899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.047146+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:07:02.047146+0000","last_peered":"2024-03-19T06:07:02.047146+0000","last_clean":"2024-03-19T06:07:02.047146+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:07:02.047146+0000","last_undegraded":"2024-03-19T06:07:02.047146+0000","last_fullsized":"2024-03-19T06:07:02.047146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241517+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:07:02.241517+0000","last_peered":"2024-03-19T06:07:02.241517+0000","last_clean":"2024-03-19T06:07:02.241517+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:07:02.241517+0000","last_undegraded":"2024-03-19T06:07:02.241517+0000","last_fullsized":"2024-03-19T06:07:02.241517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247855+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:07:02.247855+0000","last_peered":"2024-03-19T06:07:02.247855+0000","last_clean":"2024-03-19T06:07:02.247855+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:07:02.247855+0000","last_undegraded":"2024-03-19T06:07:02.247855+0000","last_fullsized":"2024-03-19T06:07:02.247855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043112+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:07:02.043112+0000","last_peered":"2024-03-19T06:07:02.043112+0000","last_clean":"2024-03-19T06:07:02.043112+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:07:02.043112+0000","last_undegraded":"2024-03-19T06:07:02.043112+0000","last_fullsized":"2024-03-19T06:07:02.043112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005165+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:07:02.005165+0000","last_peered":"2024-03-19T06:07:02.005165+0000","last_clean":"2024-03-19T06:07:02.005165+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:07:02.005165+0000","last_undegraded":"2024-03-19T06:07:02.005165+0000","last_fullsized":"2024-03-19T06:07:02.005165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.161673+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:07:02.161673+0000","last_peered":"2024-03-19T06:07:02.161673+0000","last_clean":"2024-03-19T06:07:02.161673+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:07:02.161673+0000","last_undegraded":"2024-03-19T06:07:02.161673+0000","last_fullsized":"2024-03-19T06:07:02.161673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":89,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476757,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":733283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476756,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":142361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476755,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":141725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476755,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":360448,"data_stored":146063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":145531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":339968,"data_stored":141599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":356352,"data_stored":142431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":950272,"data_stored":732627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:07:31.130 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-19T06:07:31.131 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-19T06:07:31.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-19T06:07:31.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-19T06:07:31.132 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-19T06:07:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.386+0000 7f0727400640 1 Processor -- start 2024-03-19T06:07:31.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.386+0000 7f0727400640 1 -- start start 2024-03-19T06:07:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.387+0000 7f0727400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07201541d0 0x7f07200ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.387+0000 7f0727400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f072015d860 0x7f072015dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.387+0000 7f0727400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072015d3b0 con 0x7f07200cb8d0 2024-03-19T06:07:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.388+0000 7f0727400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072015e1d0 con 0x7f072015d860 2024-03-19T06:07:31.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.388+0000 7f0727400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072015a0d0 con 0x7f07201541d0 2024-03-19T06:07:31.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.390+0000 7f0725400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f072015d860 0x7f072015dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:31.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.391+0000 7f0717e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f07200cb8d0 0x7f07200cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60304/0 (socket says 172.21.15.17:60304) 2024-03-19T06:07:31.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.391+0000 7f0717e00640 1 -- 172.21.15.17:0/4279355895 learned_addr learned my addr 172.21.15.17:0/4279355895 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.394+0000 7f0725400640 1 -- 172.21.15.17:0/4279355895 >> v2:172.21.15.153:3300/0 conn(0x7f07201541d0 msgr2=0x7f07200ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.394+0000 7f0725400640 1 --2- 172.21.15.17:0/4279355895 >> v2:172.21.15.153:3300/0 conn(0x7f07201541d0 0x7f07200ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.394+0000 7f0725400640 1 -- 172.21.15.17:0/4279355895 >> v1:172.21.15.17:6789/0 conn(0x7f07200cb8d0 legacy=0x7f07200cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.394+0000 7f0725400640 1 -- 172.21.15.17:0/4279355895 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072015a3b0 con 0x7f072015d860 2024-03-19T06:07:31.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.400+0000 7f0725400640 1 --2- 172.21.15.17:0/4279355895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f072015dc90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f072008cb70 tx=0x7f071802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15718f48cf261dc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.405+0000 7f071fe00640 1 -- 172.21.15.17:0/4279355895 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718039070 con 0x7f072015d860 2024-03-19T06:07:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.406+0000 7f071fe00640 1 -- 172.21.15.17:0/4279355895 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071802cd00 con 0x7f072015d860 2024-03-19T06:07:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.406+0000 7f071fe00640 1 -- 172.21.15.17:0/4279355895 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718034660 con 0x7f072015d860 2024-03-19T06:07:31.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.406+0000 7f0727400640 1 -- 172.21.15.17:0/4279355895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 msgr2=0x7f072015dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.406+0000 7f0727400640 1 --2- 172.21.15.17:0/4279355895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f072015dc90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f072008cb70 tx=0x7f071802bf50 comp rx=0 tx=0).stop 2024-03-19T06:07:31.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 -- 172.21.15.17:0/4279355895 shutdown_connections 2024-03-19T06:07:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 --2- 172.21.15.17:0/4279355895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f072015dc90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 --2- 172.21.15.17:0/4279355895 >> v2:172.21.15.153:3300/0 conn(0x7f07201541d0 0x7f07200ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 -- 172.21.15.17:0/4279355895 >> 172.21.15.17:0/4279355895 conn(0x7f072006baf0 msgr2=0x7f072006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 -- 172.21.15.17:0/4279355895 shutdown_connections 2024-03-19T06:07:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.407+0000 7f0727400640 1 -- 172.21.15.17:0/4279355895 wait complete. 2024-03-19T06:07:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.409+0000 7f0727400640 1 Processor -- start 2024-03-19T06:07:31.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.409+0000 7f0727400640 1 -- start start 2024-03-19T06:07:31.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07200cb8d0 0x7f072014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07201541d0 0x7f072014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720159da0 con 0x7f072015d860 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072015a970 con 0x7f07200cb8d0 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0727400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072015ac50 con 0x7f07201541d0 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.410+0000 7f0725400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.411+0000 7f0725400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47242/0 (socket says 172.21.15.17:47242) 2024-03-19T06:07:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.411+0000 7f0725400640 1 -- 172.21.15.17:0/1683299064 learned_addr learned my addr 172.21.15.17:0/1683299064 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.411+0000 7f0724a00640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07200cb8d0 0x7f072014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.412+0000 7f0717e00640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07201541d0 0x7f072014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:31.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.415+0000 7f0725400640 1 -- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07201541d0 msgr2=0x7f072014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.415+0000 7f0725400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07201541d0 0x7f072014f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.415+0000 7f0725400640 1 -- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07200cb8d0 msgr2=0x7f072014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:31.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.415+0000 7f0725400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07200cb8d0 0x7f072014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:31.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.415+0000 7f0725400640 1 -- 172.21.15.17:0/1683299064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072014e5a0 con 0x7f072015d860 2024-03-19T06:07:31.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.418+0000 7f0725400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0718037040 tx=0x7f0718004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.423+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718039050 con 0x7f072015d860 2024-03-19T06:07:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.423+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718045070 con 0x7f072015d860 2024-03-19T06:07:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.423+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071803e810 con 0x7f072015d860 2024-03-19T06:07:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.423+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072014e880 con 0x7f072015d860 2024-03-19T06:07:31.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.424+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072014ee40 con 0x7f072015d860 2024-03-19T06:07:31.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.425+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720069be0 con 0x7f072015d860 2024-03-19T06:07:31.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.447+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f071803e9b0 con 0x7f072015d860 2024-03-19T06:07:31.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.448+0000 7f071d600640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 0x7f06fc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:31.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.449+0000 7f0724a00640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 0x7f06fc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:31.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.449+0000 7f0724a00640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 0x7f06fc06e0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0710009990 tx=0x7f0710009110 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.788+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f071807a7c0 con 0x7f072015d860 2024-03-19T06:07:31.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:31.789+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f071807ce20 con 0x7f072015d860 2024-03-19T06:07:32.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.061+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f07200b21d0 con 0x7f072015d860 2024-03-19T06:07:32.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.557+0000 7f071d600640 1 -- 172.21.15.17:0/1683299064 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v7) v1 ==== 74+0+172579 (secure 0 0 0) 0x7f071807c720 con 0x7f072015d860 2024-03-19T06:07:32.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 msgr2=0x7f06fc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 0x7f06fc06e0e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0710009990 tx=0x7f0710009110 comp rx=0 tx=0).stop 2024-03-19T06:07:32.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 msgr2=0x7f0720157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0718037040 tx=0x7f0718004a40 comp rx=0 tx=0).stop 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 shutdown_connections 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f072015d860 0x7f0720157c10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07201541d0 0x7f072014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06fc06bc20 0x7f06fc06e0e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 --2- 172.21.15.17:0/1683299064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07200cb8d0 0x7f072014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 >> 172.21.15.17:0/1683299064 conn(0x7f072006baf0 msgr2=0x7f07200cf4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 shutdown_connections 2024-03-19T06:07:32.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.564+0000 7f0727400640 1 -- 172.21.15.17:0/1683299064 wait complete. 2024-03-19T06:07:32.589 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"flags":0,"active_gid":4138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":3774724855},{"type":"v1","addr":"172.21.15.17:6833","nonce":3774724855}]},"active_addr":"172.21.15.17:6833/3774724855","active_change":"2024-03-19T06:05:58.634313+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":11,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":673591819}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2590598147}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2535290705}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1732035613}]}]} 2024-03-19T06:07:32.593 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-19T06:07:32.594 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-19T06:07:32.594 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.817+0000 7fc822200640 1 Processor -- start 2024-03-19T06:07:32.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.818+0000 7fc822200640 1 -- start start 2024-03-19T06:07:32.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc81c0ca140 0x7fc81c06c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc81c0ca580 0x7fc81c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0cac30 con 0x7fc81c0ca140 2024-03-19T06:07:32.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c15d1d0 con 0x7fc81c0ca580 2024-03-19T06:07:32.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.819+0000 7fc822200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15d450 con 0x7fc81c153d90 2024-03-19T06:07:32.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.821+0000 7fc81b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:32.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.822+0000 7fc81b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49492/0 (socket says 172.21.15.17:49492) 2024-03-19T06:07:32.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.822+0000 7fc81b400640 1 -- 172.21.15.17:0/1294473815 learned_addr learned my addr 172.21.15.17:0/1294473815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:32.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.826+0000 7fc81be00640 1 --2- 172.21.15.17:0/1294473815 >> v2:172.21.15.153:3300/0 conn(0x7fc81c0ca580 0x7fc81c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.828+0000 7fc81b400640 1 -- 172.21.15.17:0/1294473815 >> v2:172.21.15.153:3300/0 conn(0x7fc81c0ca580 msgr2=0x7fc81c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.828+0000 7fc81b400640 1 --2- 172.21.15.17:0/1294473815 >> v2:172.21.15.153:3300/0 conn(0x7fc81c0ca580 0x7fc81c06ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.828+0000 7fc81b400640 1 -- 172.21.15.17:0/1294473815 >> v2:172.21.15.17:3300/0 conn(0x7fc81c0ca140 msgr2=0x7fc81c06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.828+0000 7fc81b400640 1 --2- 172.21.15.17:0/1294473815 >> v2:172.21.15.17:3300/0 conn(0x7fc81c0ca140 0x7fc81c06c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.828+0000 7fc81b400640 1 -- 172.21.15.17:0/1294473815 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c15d730 con 0x7fc81c153d90 2024-03-19T06:07:32.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.835+0000 7fc81b400640 1 --2- 172.21.15.17:0/1294473815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0cd430 tx=0x7fc80c02b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19dd08e49571dbbb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.845+0000 7fc81aa00640 1 -- 172.21.15.17:0/1294473815 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c035020 con 0x7fc81c153d90 2024-03-19T06:07:32.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.846+0000 7fc81aa00640 1 -- 172.21.15.17:0/1294473815 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c031880 con 0x7fc81c153d90 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.846+0000 7fc81aa00640 1 -- 172.21.15.17:0/1294473815 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c031c50 con 0x7fc81c153d90 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 -- 172.21.15.17:0/1294473815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 msgr2=0x7fc81c15a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 --2- 172.21.15.17:0/1294473815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0cd430 tx=0x7fc80c02b920 comp rx=0 tx=0).stop 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 -- 172.21.15.17:0/1294473815 shutdown_connections 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 --2- 172.21.15.17:0/1294473815 >> v2:172.21.15.153:3300/0 conn(0x7fc81c0ca580 0x7fc81c06ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 --2- 172.21.15.17:0/1294473815 >> v2:172.21.15.17:3300/0 conn(0x7fc81c0ca140 0x7fc81c06c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 --2- 172.21.15.17:0/1294473815 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c153d90 0x7fc81c15a7d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.847+0000 7fc822200640 1 -- 172.21.15.17:0/1294473815 >> 172.21.15.17:0/1294473815 conn(0x7fc81c066e10 msgr2=0x7fc81c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.848+0000 7fc822200640 1 -- 172.21.15.17:0/1294473815 shutdown_connections 2024-03-19T06:07:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.848+0000 7fc822200640 1 -- 172.21.15.17:0/1294473815 wait complete. 2024-03-19T06:07:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.851+0000 7fc822200640 1 Processor -- start 2024-03-19T06:07:32.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.851+0000 7fc822200640 1 -- start start 2024-03-19T06:07:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c0ca580 0x7fc81c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc81c153d90 0x7fc81c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15dfd0 con 0x7fc81c0ca140 2024-03-19T06:07:32.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c15dcf0 con 0x7fc81c153d90 2024-03-19T06:07:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.852+0000 7fc822200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cb0c0 con 0x7fc81c0ca580 2024-03-19T06:07:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.853+0000 7fc81b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.854+0000 7fc81b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47266/0 (socket says 172.21.15.17:47266) 2024-03-19T06:07:32.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.854+0000 7fc81b400640 1 -- 172.21.15.17:0/645326390 learned_addr learned my addr 172.21.15.17:0/645326390 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:32.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.854+0000 7fc813e00640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c0ca580 0x7fc81c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:32.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.860+0000 7fc81b400640 1 -- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c0ca580 msgr2=0x7fc81c14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.860+0000 7fc81b400640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c0ca580 0x7fc81c14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.860+0000 7fc81b400640 1 -- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc81c153d90 msgr2=0x7fc81c1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.860+0000 7fc81b400640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc81c153d90 0x7fc81c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:32.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.860+0000 7fc81b400640 1 -- 172.21.15.17:0/645326390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c14ea40 con 0x7fc81c0ca140 2024-03-19T06:07:32.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.863+0000 7fc81b400640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc80c02b960 tx=0x7fc80c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:32.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.869+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c040070 con 0x7fc81c0ca140 2024-03-19T06:07:32.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.869+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80c030c90 con 0x7fc81c0ca140 2024-03-19T06:07:32.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.869+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c158f50 con 0x7fc81c0ca140 2024-03-19T06:07:32.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.869+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80c035040 con 0x7fc81c0ca140 2024-03-19T06:07:32.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.869+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c14ef90 con 0x7fc81c0ca140 2024-03-19T06:07:32.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:32.871+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c069be0 con 0x7fc81c0ca140 2024-03-19T06:07:33.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.189+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc80c038020 con 0x7fc81c0ca140 2024-03-19T06:07:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.190+0000 7fc813400640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 0x7fc7f806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.191+0000 7fc813e00640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 0x7fc7f806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.192+0000 7fc813e00640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 0x7fc7f806e110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc81c15aa40 tx=0x7fc804009110 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:33.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.225+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc80c030e40 con 0x7fc81c0ca140 2024-03-19T06:07:33.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.226+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc80c07bd30 con 0x7fc81c0ca140 2024-03-19T06:07:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.445+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81c158680 con 0x7fc81c0ca140 2024-03-19T06:07:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.542+0000 7fc813400640 1 -- 172.21.15.17:0/645326390 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fc80c07b630 con 0x7fc81c0ca140 2024-03-19T06:07:33.533 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:33.533 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 msgr2=0x7fc7f806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 0x7fc7f806e110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc81c15aa40 tx=0x7fc804009110 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 msgr2=0x7fc81c1588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc80c02b960 tx=0x7fc80c0046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 shutdown_connections 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc7f806bc50 0x7fc7f806e110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc81c153d90 0x7fc81c1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc81c0ca580 0x7fc81c14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 --2- 172.21.15.17:0/645326390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc81c0ca140 0x7fc81c1588a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 >> 172.21.15.17:0/645326390 conn(0x7fc81c066e10 msgr2=0x7fc81c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:33.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 shutdown_connections 2024-03-19T06:07:33.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.545+0000 7fc822200640 1 -- 172.21.15.17:0/645326390 wait complete. 2024-03-19T06:07:33.555 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-19T06:07:33.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:33.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.780+0000 7f40cdc00640 1 Processor -- start 2024-03-19T06:07:33.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.780+0000 7f40cdc00640 1 -- start start 2024-03-19T06:07:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.781+0000 7f40cdc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c81586a0 0x7f40c815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.781+0000 7f40cdc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40c806e720 0x7f40c806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.782+0000 7f40cdc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c80c6b70 con 0x7f40c80c7570 2024-03-19T06:07:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.782+0000 7f40cdc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c8073170 con 0x7f40c806e720 2024-03-19T06:07:33.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.782+0000 7f40cdc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8162660 con 0x7f40c81586a0 2024-03-19T06:07:33.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.783+0000 7f40c7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40c806e720 0x7f40c806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.783+0000 7f40bfe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f40c80c7570 0x7f40c8070c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60306/0 (socket says 172.21.15.17:60306) 2024-03-19T06:07:33.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.783+0000 7f40bfe00640 1 -- 172.21.15.17:0/487612143 learned_addr learned my addr 172.21.15.17:0/487612143 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.787+0000 7f40c7400640 1 -- 172.21.15.17:0/487612143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c81586a0 msgr2=0x7f40c815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.787+0000 7f40c7400640 1 --2- 172.21.15.17:0/487612143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c81586a0 0x7f40c815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.787+0000 7f40c7400640 1 -- 172.21.15.17:0/487612143 >> v1:172.21.15.17:6789/0 conn(0x7f40c80c7570 legacy=0x7f40c8070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.787+0000 7f40c7400640 1 -- 172.21.15.17:0/487612143 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80c6890 con 0x7f40c806e720 2024-03-19T06:07:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.793+0000 7f40c7400640 1 --2- 172.21.15.17:0/487612143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c806eb80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0b9e3a435409ce server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.806+0000 7f40c6000640 1 -- 172.21.15.17:0/487612143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0039070 con 0x7f40c806e720 2024-03-19T06:07:33.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.806+0000 7f40c6000640 1 -- 172.21.15.17:0/487612143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c002cce0 con 0x7f40c806e720 2024-03-19T06:07:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.806+0000 7f40c6000640 1 -- 172.21.15.17:0/487612143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0034660 con 0x7f40c806e720 2024-03-19T06:07:33.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 -- 172.21.15.17:0/487612143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 msgr2=0x7f40c806eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 --2- 172.21.15.17:0/487612143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c806eb80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009d90 tx=0x7f40c002bf30 comp rx=0 tx=0).stop 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 -- 172.21.15.17:0/487612143 shutdown_connections 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 --2- 172.21.15.17:0/487612143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c806eb80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 --2- 172.21.15.17:0/487612143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c81586a0 0x7f40c815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 -- 172.21.15.17:0/487612143 >> 172.21.15.17:0/487612143 conn(0x7f40c80c8910 msgr2=0x7f40c80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 -- 172.21.15.17:0/487612143 shutdown_connections 2024-03-19T06:07:33.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.807+0000 7f40cdc00640 1 -- 172.21.15.17:0/487612143 wait complete. 2024-03-19T06:07:33.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.809+0000 7f40cdc00640 1 Processor -- start 2024-03-19T06:07:33.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.809+0000 7f40cdc00640 1 -- start start 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c80c7570 0x7f40c8071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 0x7f40c81f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8161e60 con 0x7f40c806e720 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8161b80 con 0x7f40c81586a0 2024-03-19T06:07:33.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.810+0000 7f40cdc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8162140 con 0x7f40c80c7570 2024-03-19T06:07:33.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.812+0000 7f40c7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 0x7f40c81f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.813+0000 7f40c7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 0x7f40c81f7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41264/0 (socket says 172.21.15.17:41264) 2024-03-19T06:07:33.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.813+0000 7f40c7400640 1 -- 172.21.15.17:0/3912651582 learned_addr learned my addr 172.21.15.17:0/3912651582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:33.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.816+0000 7f40c6a00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.820+0000 7f40bfe00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c80c7570 0x7f40c8071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.821+0000 7f40c6a00640 1 -- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c80c7570 msgr2=0x7f40c8071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.821+0000 7f40c6a00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c80c7570 0x7f40c8071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.821+0000 7f40c6a00640 1 -- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 msgr2=0x7f40c81f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:33.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.821+0000 7f40c6a00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 0x7f40c81f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:33.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.821+0000 7f40c6a00640 1 -- 172.21.15.17:0/3912651582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8160b00 con 0x7f40c806e720 2024-03-19T06:07:33.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.823+0000 7f40c6a00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c80c91c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b3f0 tx=0x7f40b800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.829+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8015020 con 0x7f40c806e720 2024-03-19T06:07:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.829+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8011830 con 0x7f40c806e720 2024-03-19T06:07:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.829+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8011c20 con 0x7f40c806e720 2024-03-19T06:07:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.830+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c8160de0 con 0x7f40c806e720 2024-03-19T06:07:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.830+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c81613a0 con 0x7f40c806e720 2024-03-19T06:07:33.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.831+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c81615a0 con 0x7f40c806e720 2024-03-19T06:07:33.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.853+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f40b8018020 con 0x7f40c806e720 2024-03-19T06:07:33.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.856+0000 7f40bea00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.856+0000 7f40bfe00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:33.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.856+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f40b80573f0 con 0x7f40c806e720 2024-03-19T06:07:33.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:33.857+0000 7f40bfe00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40c80c6220 tx=0x7f40b0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.148+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f40c81615a0 con 0x7f40c806e720 2024-03-19T06:07:34.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.395+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40c8158200 con 0x7f40c806e720 2024-03-19T06:07:34.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.488+0000 7f40bea00640 1 -- 172.21.15.17:0/3912651582 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f40c8158200 con 0x7f40c806e720 2024-03-19T06:07:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:34.480 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.491+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 msgr2=0x7f40a406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.491+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f40c80c6220 tx=0x7f40b0009040 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.491+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 msgr2=0x7f40c80c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.491+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c80c91c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40b800b3f0 tx=0x7f40b800b8b0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 shutdown_connections 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c81586a0 0x7f40c81f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c80c7570 0x7f40c8071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 --2- 172.21.15.17:0/3912651582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c806e720 0x7f40c80c91c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 >> 172.21.15.17:0/3912651582 conn(0x7f40c80c8910 msgr2=0x7f40c80c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 shutdown_connections 2024-03-19T06:07:34.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.492+0000 7f40cdc00640 1 -- 172.21.15.17:0/3912651582 wait complete. 2024-03-19T06:07:34.504 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-19T06:07:34.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-19T06:07:34.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-19T06:07:34.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-19T06:07:34.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-19T06:07:34.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-19T06:07:34.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-19T06:07:34.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-19T06:07:34.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.851+0000 7f8469000640 1 Processor -- start 2024-03-19T06:07:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.851+0000 7f8469000640 1 -- start start 2024-03-19T06:07:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.853+0000 7f8469000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f846414fb90 0x7f8464155a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.853+0000 7f8469000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f84640c7ce0 0x7f84640c8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.853+0000 7f8469000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84640c6180 con 0x7f846414ff70 2024-03-19T06:07:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.853+0000 7f8469000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846406d750 con 0x7f84640c7ce0 2024-03-19T06:07:34.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.853+0000 7f8469000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846406da30 con 0x7f846414fb90 2024-03-19T06:07:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.855+0000 7f8462a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f846414ff70 0x7f846406cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60318/0 (socket says 172.21.15.17:60318) 2024-03-19T06:07:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.856+0000 7f8462a00640 1 -- 172.21.15.17:0/2337043394 learned_addr learned my addr 172.21.15.17:0/2337043394 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:34.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.858+0000 7fb174a00640 1 Processor -- start 2024-03-19T06:07:34.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.859+0000 7fb174a00640 1 -- start start 2024-03-19T06:07:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7fb174a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 0x7fb16804e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7fb174a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb1680476c0 0x7fb16804edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7fb174a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168009b50 con 0x7fb16804f2f0 2024-03-19T06:07:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7fb174a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16800abf0 con 0x7fb1680476c0 2024-03-19T06:07:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7fb174a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16804d060 con 0x7fb1680d7090 2024-03-19T06:07:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.859+0000 7f7532c00640 1 Processor -- start 2024-03-19T06:07:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.860+0000 7f7532c00640 1 -- start start 2024-03-19T06:07:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.861+0000 7f1ad3e00640 1 Processor -- start 2024-03-19T06:07:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.862+0000 7f8463400640 1 --2- 172.21.15.17:0/2337043394 >> v2:172.21.15.153:3300/0 conn(0x7f846414fb90 0x7f8464155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f7532c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75240d5200 0x7f752404b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.861+0000 7f1ad3e00640 1 -- start start 2024-03-19T06:07:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f7532c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f7532c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7524045ed0 con 0x7f752404b090 2024-03-19T06:07:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f2030e00640 1 Processor -- start 2024-03-19T06:07:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f2030e00640 1 -- start start 2024-03-19T06:07:34.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f7532c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7524046f30 con 0x7f75240d5200 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f1ad3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ad414fb90 0x7f1ad4155a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f1ad3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1ad414ff70 0x7f1ad406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.863+0000 7f1ad3e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40c6180 con 0x7f1ad406d170 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f1ad3e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad406d750 con 0x7f1ad414fb90 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f1ad3e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad406da30 con 0x7f1ad414ff70 2024-03-19T06:07:34.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.864+0000 7f7532c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7524046170 con 0x7f7524005e90 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.865+0000 7f2030e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.865+0000 7f2030e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f202c0cb8d0 0x7f202c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.865+0000 7f2030e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c15d3b0 con 0x7f202c0cb2d0 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.865+0000 7f2030e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c15a0d0 con 0x7f202c0cb8d0 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.865+0000 7f2030e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15a3b0 con 0x7f202c1541d0 2024-03-19T06:07:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.866+0000 7f7532200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.867+0000 7f7532200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49526/0 (socket says 172.21.15.17:49526) 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.867+0000 7f7532200640 1 -- 172.21.15.17:0/2688579368 learned_addr learned my addr 172.21.15.17:0/2688579368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.868+0000 7f8463400640 1 -- 172.21.15.17:0/2337043394 >> v2:172.21.15.17:3300/0 conn(0x7f84640c7ce0 msgr2=0x7f84640c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.868+0000 7f8463400640 1 --2- 172.21.15.17:0/2337043394 >> v2:172.21.15.17:3300/0 conn(0x7f84640c7ce0 0x7f84640c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.868+0000 7f8463400640 1 -- 172.21.15.17:0/2337043394 >> v1:172.21.15.17:6789/0 conn(0x7f846414ff70 legacy=0x7f846406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.868+0000 7f8463400640 1 -- 172.21.15.17:0/2337043394 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846406dd10 con 0x7f846414fb90 2024-03-19T06:07:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.870+0000 7fae7e400640 1 Processor -- start 2024-03-19T06:07:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.870+0000 7f2029e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.871+0000 7fae7e400640 1 -- start start 2024-03-19T06:07:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.872+0000 7fae7e400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fae78153e90 0x7fae780caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.872+0000 7fae7e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 0x7fae780ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.872+0000 7fae7e400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae78154270 con 0x7fae780ca610 2024-03-19T06:07:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.872+0000 7fae7e400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae78159cd0 con 0x7fae78153e90 2024-03-19T06:07:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.872+0000 7fae7e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae78159fb0 con 0x7fae780cb400 2024-03-19T06:07:34.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.874+0000 7f8463400640 1 --2- 172.21.15.17:0/2337043394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846414fb90 0x7f8464155a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8464074820 tx=0x7f845002df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fbfb29f05d30be4 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.875+0000 7f7532200640 1 -- 172.21.15.17:0/2688579368 >> v2:172.21.15.153:3300/0 conn(0x7f75240d5200 msgr2=0x7f752404b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.875+0000 7f7532200640 1 --2- 172.21.15.17:0/2688579368 >> v2:172.21.15.153:3300/0 conn(0x7f75240d5200 0x7f752404b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.875+0000 7f7532200640 1 -- 172.21.15.17:0/2688579368 >> v1:172.21.15.17:6789/0 conn(0x7f752404b090 legacy=0x7f75240db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.875+0000 7f7532200640 1 -- 172.21.15.17:0/2688579368 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524046450 con 0x7f7524005e90 2024-03-19T06:07:34.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.880+0000 7fb972a00640 1 Processor -- start 2024-03-19T06:07:34.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.881+0000 7fb972a00640 1 -- start start 2024-03-19T06:07:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.881+0000 7f2029e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49534/0 (socket says 172.21.15.17:49534) 2024-03-19T06:07:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.881+0000 7f2029e00640 1 -- 172.21.15.17:0/4168397977 learned_addr learned my addr 172.21.15.17:0/4168397977 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fb972a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb96c0c7570 0x7fb96c15ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fb972a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 0x7fb96c06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fb972a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c0c6b70 con 0x7fb96c1586a0 2024-03-19T06:07:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fb972a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c073170 con 0x7fb96c0c7570 2024-03-19T06:07:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fb972a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c162660 con 0x7fb96c06e720 2024-03-19T06:07:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.882+0000 7fae77e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 0x7fae780ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.883+0000 7f7532200640 1 --2- 172.21.15.17:0/2688579368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8157830b2b5cd265 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.884+0000 7fae77e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 0x7fae780ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49544/0 (socket says 172.21.15.17:49544) 2024-03-19T06:07:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.884+0000 7fae77e00640 1 -- 172.21.15.17:0/1368779743 learned_addr learned my addr 172.21.15.17:0/1368779743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.885+0000 7fb16f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 0x7fb16804e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.887+0000 7fb16f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 0x7fb16804e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41288/0 (socket says 172.21.15.17:41288) 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.887+0000 7fb16f400640 1 -- 172.21.15.17:0/577417640 learned_addr learned my addr 172.21.15.17:0/577417640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.887+0000 7f1ad2a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ad414fb90 0x7f1ad4155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.889+0000 7f1ad2a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1ad414fb90 0x7f1ad4155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47324/0 (socket says 172.21.15.17:47324) 2024-03-19T06:07:34.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.889+0000 7f1ad2a00640 1 -- 172.21.15.17:0/360990991 learned_addr learned my addr 172.21.15.17:0/360990991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.891+0000 7f80d1200640 1 Processor -- start 2024-03-19T06:07:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.891+0000 7fae7d000640 1 --2- 172.21.15.17:0/1368779743 >> v2:172.21.15.17:3300/0 conn(0x7fae78153e90 0x7fae780caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.892+0000 7f80d1200640 1 -- start start 2024-03-19T06:07:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.893+0000 7fb16ea00640 1 --2- 172.21.15.17:0/577417640 >> v2:172.21.15.17:3300/0 conn(0x7fb1680476c0 0x7fb16804edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.893+0000 7f80d1200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc070d30 0x7f80cc071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.893+0000 7f80d1200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc1542b0 con 0x7f80cc153ed0 2024-03-19T06:07:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.893+0000 7f80d1200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc15d5c0 con 0x7f80cc15aa00 2024-03-19T06:07:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.893+0000 7f80d1200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc15e1d0 con 0x7f80cc070d30 2024-03-19T06:07:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.895+0000 7f1ad2a00640 1 -- 172.21.15.17:0/360990991 >> v2:172.21.15.153:3300/0 conn(0x7f1ad414ff70 msgr2=0x7f1ad406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.895+0000 7f1ad2a00640 1 --2- 172.21.15.17:0/360990991 >> v2:172.21.15.153:3300/0 conn(0x7f1ad414ff70 0x7f1ad406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.895+0000 7f1ad2a00640 1 -- 172.21.15.17:0/360990991 >> v1:172.21.15.153:6789/0 conn(0x7f1ad406d170 legacy=0x7f1ad40c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.895+0000 7f1ad2a00640 1 -- 172.21.15.17:0/360990991 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad406dd10 con 0x7f1ad414fb90 2024-03-19T06:07:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.896+0000 7f2029e00640 1 -- 172.21.15.17:0/4168397977 >> v2:172.21.15.153:3300/0 conn(0x7f202c0cb8d0 msgr2=0x7f202c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.896+0000 7f2029e00640 1 --2- 172.21.15.17:0/4168397977 >> v2:172.21.15.153:3300/0 conn(0x7f202c0cb8d0 0x7f202c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.896+0000 7f2029e00640 1 -- 172.21.15.17:0/4168397977 >> v1:172.21.15.17:6789/0 conn(0x7f202c0cb2d0 legacy=0x7f202c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.896+0000 7f2029e00640 1 -- 172.21.15.17:0/4168397977 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c15a690 con 0x7f202c1541d0 2024-03-19T06:07:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.898+0000 7fb16ea00640 1 -- 172.21.15.17:0/577417640 >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 msgr2=0x7fb16804e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.898+0000 7fb16ea00640 1 --2- 172.21.15.17:0/577417640 >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 0x7fb16804e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.898+0000 7fb16ea00640 1 -- 172.21.15.17:0/577417640 >> v1:172.21.15.153:6789/0 conn(0x7fb16804f2f0 legacy=0x7fb1680e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.898+0000 7fb16ea00640 1 -- 172.21.15.17:0/577417640 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16804d820 con 0x7fb1680476c0 2024-03-19T06:07:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.902+0000 7fae7d000640 1 -- 172.21.15.17:0/1368779743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 msgr2=0x7fae780ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.902+0000 7fae7d000640 1 --2- 172.21.15.17:0/1368779743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 0x7fae780ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.902+0000 7fae7d000640 1 -- 172.21.15.17:0/1368779743 >> v1:172.21.15.153:6789/0 conn(0x7fae780ca610 legacy=0x7fae7815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.903+0000 7fae7d000640 1 -- 172.21.15.17:0/1368779743 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7815a290 con 0x7fae78153e90 2024-03-19T06:07:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.905+0000 7f1ad2a00640 1 --2- 172.21.15.17:0/360990991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414fb90 0x7f1ad4155a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4074820 tx=0x7f1ac002dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7041ff67b8c785cf server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.905+0000 7fae7d000640 1 --2- 172.21.15.17:0/1368779743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae78153e90 0x7fae780caec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097a0 tx=0x7fae6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed8e16b060daa78 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.906+0000 7fb16ea00640 1 --2- 172.21.15.17:0/577417640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1680476c0 0x7fb16804edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb16804ff40 tx=0x7fb16402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcbab8795a7f698 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.907+0000 7fb96b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb96c0c7570 0x7fb96c15ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.909+0000 7fb970a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 0x7fb96c06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.912+0000 7f752be00640 1 -- 172.21.15.17:0/2688579368 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c034070 con 0x7f7524005e90 2024-03-19T06:07:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.912+0000 7f752be00640 1 -- 172.21.15.17:0/2688579368 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c030840 con 0x7f7524005e90 2024-03-19T06:07:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.912+0000 7f752be00640 1 -- 172.21.15.17:0/2688579368 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c030c10 con 0x7f7524005e90 2024-03-19T06:07:34.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.912+0000 7fb970a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 0x7fb96c06ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41312/0 (socket says 172.21.15.17:41312) 2024-03-19T06:07:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.912+0000 7fb970a00640 1 -- 172.21.15.17:0/3891312548 learned_addr learned my addr 172.21.15.17:0/3891312548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 -- 172.21.15.17:0/2688579368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 msgr2=0x7f7524045330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 --2- 172.21.15.17:0/2688579368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b980 comp rx=0 tx=0).stop 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 -- 172.21.15.17:0/2688579368 shutdown_connections 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 --2- 172.21.15.17:0/2688579368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7524005e90 0x7f7524045330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 --2- 172.21.15.17:0/2688579368 >> v2:172.21.15.153:3300/0 conn(0x7f75240d5200 0x7f752404b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 -- 172.21.15.17:0/2688579368 >> 172.21.15.17:0/2688579368 conn(0x7f7524050180 msgr2=0x7f7524050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 -- 172.21.15.17:0/2688579368 shutdown_connections 2024-03-19T06:07:34.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.913+0000 7f7532c00640 1 -- 172.21.15.17:0/2688579368 wait complete. 2024-03-19T06:07:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.915+0000 7f7532c00640 1 Processor -- start 2024-03-19T06:07:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.915+0000 7f7532c00640 1 -- start start 2024-03-19T06:07:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7524005e90 0x7f75240cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 0x7f7524172f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75240d5200 0x7f75240343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752400e2a0 con 0x7f75240d5200 2024-03-19T06:07:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524046a10 con 0x7f7524005e90 2024-03-19T06:07:34.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.916+0000 7f7532c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752400e420 con 0x7f752404b090 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.918+0000 7f1ad1600640 1 -- 172.21.15.17:0/360990991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0007ce0 con 0x7f1ad414fb90 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.918+0000 7f1ad1600640 1 -- 172.21.15.17:0/360990991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00090d0 con 0x7f1ad414fb90 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.918+0000 7f1ad1600640 1 -- 172.21.15.17:0/360990991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00094a0 con 0x7f1ad414fb90 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.918+0000 7f8462000640 1 -- 172.21.15.17:0/2337043394 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450034070 con 0x7f846414fb90 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f8462000640 1 -- 172.21.15.17:0/2337043394 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845002ed30 con 0x7f846414fb90 2024-03-19T06:07:34.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f8462000640 1 -- 172.21.15.17:0/2337043394 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450038620 con 0x7f846414fb90 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 -- 172.21.15.17:0/360990991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414fb90 msgr2=0x7f1ad4155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/360990991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414fb90 0x7f1ad4155a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4074820 tx=0x7f1ac002dba0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 -- 172.21.15.17:0/360990991 shutdown_connections 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/360990991 >> v2:172.21.15.153:3300/0 conn(0x7f1ad414ff70 0x7f1ad406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/360990991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414fb90 0x7f1ad4155a30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 -- 172.21.15.17:0/360990991 >> 172.21.15.17:0/360990991 conn(0x7f1ad406e630 msgr2=0x7f1ad406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 -- 172.21.15.17:0/360990991 shutdown_connections 2024-03-19T06:07:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f8469000640 1 -- 172.21.15.17:0/2337043394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846414fb90 msgr2=0x7f8464155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f8469000640 1 --2- 172.21.15.17:0/2337043394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846414fb90 0x7f8464155a30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8464074820 tx=0x7f845002df80 comp rx=0 tx=0).stop 2024-03-19T06:07:34.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.919+0000 7f1ad3e00640 1 -- 172.21.15.17:0/360990991 wait complete. 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 -- 172.21.15.17:0/2337043394 shutdown_connections 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 --2- 172.21.15.17:0/2337043394 >> v2:172.21.15.17:3300/0 conn(0x7f84640c7ce0 0x7f84640c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 --2- 172.21.15.17:0/2337043394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f846414fb90 0x7f8464155a30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 -- 172.21.15.17:0/2337043394 >> 172.21.15.17:0/2337043394 conn(0x7f846406e630 msgr2=0x7f846406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 -- 172.21.15.17:0/2337043394 shutdown_connections 2024-03-19T06:07:34.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.920+0000 7f8469000640 1 -- 172.21.15.17:0/2337043394 wait complete. 2024-03-19T06:07:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fb96b400640 1 -- 172.21.15.17:0/3891312548 >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 msgr2=0x7fb96c06ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fb96b400640 1 --2- 172.21.15.17:0/3891312548 >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 0x7fb96c06ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fb96b400640 1 -- 172.21.15.17:0/3891312548 >> v1:172.21.15.153:6789/0 conn(0x7fb96c1586a0 legacy=0x7fb96c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fb96b400640 1 -- 172.21.15.17:0/3891312548 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c0c6890 con 0x7fb96c0c7570 2024-03-19T06:07:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7f1ad3e00640 1 Processor -- start 2024-03-19T06:07:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7f1ad3e00640 1 -- start start 2024-03-19T06:07:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fae77400640 1 -- 172.21.15.17:0/1368779743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0315a0 con 0x7fae78153e90 2024-03-19T06:07:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fae77400640 1 -- 172.21.15.17:0/1368779743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c037070 con 0x7fae78153e90 2024-03-19T06:07:34.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7fae77400640 1 -- 172.21.15.17:0/1368779743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c031960 con 0x7fae78153e90 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.922+0000 7f8469000640 1 Processor -- start 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7f8469000640 1 -- start start 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 -- 172.21.15.17:0/1368779743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae78153e90 msgr2=0x7fae780caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 --2- 172.21.15.17:0/1368779743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae78153e90 0x7fae780caec0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097a0 tx=0x7fae6c02b840 comp rx=0 tx=0).stop 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 -- 172.21.15.17:0/1368779743 shutdown_connections 2024-03-19T06:07:34.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 --2- 172.21.15.17:0/1368779743 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae780cb400 0x7fae780ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 --2- 172.21.15.17:0/1368779743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae78153e90 0x7fae780caec0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7fae7e400640 1 -- 172.21.15.17:0/1368779743 >> 172.21.15.17:0/1368779743 conn(0x7fae7806b540 msgr2=0x7fae7806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.923+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad406d170 0x7f1ad4151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7fae7e400640 1 -- 172.21.15.17:0/1368779743 shutdown_connections 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad414fb90 0x7f1ad4071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f1ad3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 0x7f1ad4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c83f0 con 0x7f1ad414ff70 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c6700 con 0x7f1ad414fb90 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f1ad3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40c8570 con 0x7f1ad406d170 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f2029e00640 1 --2- 172.21.15.17:0/4168397977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1cffec5f5820ce1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7fae7e400640 1 -- 172.21.15.17:0/1368779743 wait complete. 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84640c7ce0 0x7f8464155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 0x7f8464154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846414ff70 0x7f84640ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846406d340 con 0x7f846414fb90 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84640c6700 con 0x7f84640c7ce0 2024-03-19T06:07:34.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.924+0000 7f8469000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846406d4c0 con 0x7f846414ff70 2024-03-19T06:07:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.925+0000 7f7530e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 0x7f7524172f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.926+0000 7fae7e400640 1 Processor -- start 2024-03-19T06:07:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.926+0000 7fae7e400640 1 -- start start 2024-03-19T06:07:34.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.926+0000 7fb96b400640 1 --2- 172.21.15.17:0/3891312548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c0c7570 0x7fb96c15ec20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0c9170 tx=0x7fb95802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9bcd89a93a29a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae780ca610 0x7fae781f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae780cb400 0x7fae780cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae78153e90 0x7fae7815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c6750 con 0x7fae780cb400 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7815a850 con 0x7fae780ca610 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7fae7e400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780b5120 con 0x7fae78153e90 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.927+0000 7f7530e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 0x7f7524172f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49550/0 (socket says 172.21.15.17:49550) 2024-03-19T06:07:34.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.928+0000 7f7530e00640 1 -- 172.21.15.17:0/2824631525 learned_addr learned my addr 172.21.15.17:0/2824631525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.932+0000 7f80ca800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc070d30 0x7f80cc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.932+0000 7f7532200640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75240d5200 0x7f75240343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.933+0000 7f80ca800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f80cc070d30 0x7f80cc071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47364/0 (socket says 172.21.15.17:47364) 2024-03-19T06:07:34.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.933+0000 7f80ca800640 1 -- 172.21.15.17:0/2565687774 learned_addr learned my addr 172.21.15.17:0/2565687774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.937+0000 7f80ca800640 1 -- 172.21.15.17:0/2565687774 >> v1:172.21.15.153:6789/0 conn(0x7f80cc15aa00 legacy=0x7f80cc0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.937+0000 7f80ca800640 1 -- 172.21.15.17:0/2565687774 >> v1:172.21.15.17:6789/0 conn(0x7f80cc153ed0 legacy=0x7f80cc06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.937+0000 7f80ca800640 1 -- 172.21.15.17:0/2565687774 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc15d8a0 con 0x7f80cc070d30 2024-03-19T06:07:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.939+0000 7f7530e00640 1 -- 172.21.15.17:0/2824631525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7524005e90 msgr2=0x7f75240cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.939+0000 7f7530e00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7524005e90 0x7f75240cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.939+0000 7f7530e00640 1 -- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75240d5200 msgr2=0x7f75240343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.939+0000 7f7530e00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75240d5200 0x7f75240343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.939+0000 7f7530e00640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524172740 con 0x7f752404b090 2024-03-19T06:07:34.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.946+0000 7f80ca800640 1 --2- 172.21.15.17:0/2565687774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc070d30 0x7f80cc071140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409fbf5b6d1a2a30 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.947+0000 7fb16e000640 1 -- 172.21.15.17:0/577417640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1640315a0 con 0x7fb1680476c0 2024-03-19T06:07:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.947+0000 7fb16e000640 1 -- 172.21.15.17:0/577417640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164037070 con 0x7fb1680476c0 2024-03-19T06:07:34.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.947+0000 7fb16e000640 1 -- 172.21.15.17:0/577417640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164031960 con 0x7fb1680476c0 2024-03-19T06:07:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 -- 172.21.15.17:0/577417640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1680476c0 msgr2=0x7fb16804edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 --2- 172.21.15.17:0/577417640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1680476c0 0x7fb16804edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb16804ff40 tx=0x7fb16402b840 comp rx=0 tx=0).stop 2024-03-19T06:07:34.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 -- 172.21.15.17:0/577417640 shutdown_connections 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 --2- 172.21.15.17:0/577417640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1680476c0 0x7fb16804edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 --2- 172.21.15.17:0/577417640 >> v2:172.21.15.153:3300/0 conn(0x7fb1680d7090 0x7fb16804e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 -- 172.21.15.17:0/577417640 >> 172.21.15.17:0/577417640 conn(0x7fb16800e6a0 msgr2=0x7fb168009d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 -- 172.21.15.17:0/577417640 shutdown_connections 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.948+0000 7fb174a00640 1 -- 172.21.15.17:0/577417640 wait complete. 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.949+0000 7fb96aa00640 1 -- 172.21.15.17:0/3891312548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958035020 con 0x7fb96c0c7570 2024-03-19T06:07:34.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.949+0000 7fb96aa00640 1 -- 172.21.15.17:0/3891312548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958031830 con 0x7fb96c0c7570 2024-03-19T06:07:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.949+0000 7fb96aa00640 1 -- 172.21.15.17:0/3891312548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958031c00 con 0x7fb96c0c7570 2024-03-19T06:07:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.949+0000 7f8462a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 0x7f8464154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.949+0000 7f1ad3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 0x7f1ad4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb174a00640 1 Processor -- start 2024-03-19T06:07:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 -- 172.21.15.17:0/3891312548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c0c7570 msgr2=0x7fb96c15ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 --2- 172.21.15.17:0/3891312548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c0c7570 0x7fb96c15ec20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0c9170 tx=0x7fb95802b8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb174a00640 1 -- start start 2024-03-19T06:07:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7f1ad3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 0x7f1ad4150380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47382/0 (socket says 172.21.15.17:47382) 2024-03-19T06:07:34.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7f1ad3400640 1 -- 172.21.15.17:0/614250621 learned_addr learned my addr 172.21.15.17:0/614250621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 -- 172.21.15.17:0/3891312548 shutdown_connections 2024-03-19T06:07:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 --2- 172.21.15.17:0/3891312548 >> v2:172.21.15.153:3300/0 conn(0x7fb96c06e720 0x7fb96c06ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 --2- 172.21.15.17:0/3891312548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c0c7570 0x7fb96c15ec20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 -- 172.21.15.17:0/3891312548 >> 172.21.15.17:0/3891312548 conn(0x7fb96c0c8910 msgr2=0x7fb96c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 -- 172.21.15.17:0/3891312548 shutdown_connections 2024-03-19T06:07:34.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.950+0000 7fb972a00640 1 -- 172.21.15.17:0/3891312548 wait complete. 2024-03-19T06:07:34.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1680476c0 0x7fb1680cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb16804f2f0 0x7fb1680dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 0x7fb1680c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16804cd20 con 0x7fb16804f2f0 2024-03-19T06:07:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16804dde0 con 0x7fb1680476c0 2024-03-19T06:07:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.951+0000 7fb174a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680e0840 con 0x7fb1680d7090 2024-03-19T06:07:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.952+0000 7fb972a00640 1 Processor -- start 2024-03-19T06:07:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.952+0000 7fb972a00640 1 -- start start 2024-03-19T06:07:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c06e720 0x7fb96c1f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb96c0c7570 0x7fb96c15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb96c1586a0 0x7fb96c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c161e60 con 0x7fb96c06e720 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c161b80 con 0x7fb96c1586a0 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.953+0000 7fb972a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c162140 con 0x7fb96c0c7570 2024-03-19T06:07:34.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.954+0000 7f2029400640 1 -- 172.21.15.17:0/4168397977 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c034070 con 0x7f202c1541d0 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.954+0000 7f2029400640 1 -- 172.21.15.17:0/4168397977 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c030840 con 0x7f202c1541d0 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.954+0000 7f2029400640 1 -- 172.21.15.17:0/4168397977 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c030c10 con 0x7f202c1541d0 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 -- 172.21.15.17:0/4168397977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 msgr2=0x7f202c0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 --2- 172.21.15.17:0/4168397977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f201c009870 tx=0x7f201c02b980 comp rx=0 tx=0).stop 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f8462a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 0x7f8464154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47390/0 (socket says 172.21.15.17:47390) 2024-03-19T06:07:34.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f8462a00640 1 -- 172.21.15.17:0/1374132097 learned_addr learned my addr 172.21.15.17:0/1374132097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 -- 172.21.15.17:0/4168397977 shutdown_connections 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 --2- 172.21.15.17:0/4168397977 >> v2:172.21.15.153:3300/0 conn(0x7f202c0cb8d0 0x7f202c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 --2- 172.21.15.17:0/4168397977 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c1541d0 0x7f202c0ca2a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 -- 172.21.15.17:0/4168397977 >> 172.21.15.17:0/4168397977 conn(0x7f202c06baf0 msgr2=0x7f202c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 -- 172.21.15.17:0/4168397977 shutdown_connections 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.955+0000 7f2030e00640 1 -- 172.21.15.17:0/4168397977 wait complete. 2024-03-19T06:07:34.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.957+0000 7f2030e00640 1 Processor -- start 2024-03-19T06:07:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.957+0000 7f2030e00640 1 -- start start 2024-03-19T06:07:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202c0cb2d0 0x7f202c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c0cb8d0 0x7f202c151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202c1541d0 0x7f202c1f0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15ac50 con 0x7f202c0cb2d0 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c159da0 con 0x7f202c1541d0 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f2030e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0ca7e0 con 0x7f202c0cb8d0 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f1ad3400640 1 -- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad406d170 msgr2=0x7f1ad4151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f1ad3400640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1ad406d170 0x7f1ad4151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f1ad3400640 1 -- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad414fb90 msgr2=0x7f1ad4071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f1ad3400640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ad414fb90 0x7f1ad4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.958+0000 7f1ad3400640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad41f3300 con 0x7f1ad414ff70 2024-03-19T06:07:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.961+0000 7f7530e00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 0x7f7524172f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f752000c470 tx=0x7f752000c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7f8462a00640 1 -- 172.21.15.17:0/1374132097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846414ff70 msgr2=0x7f84640ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7f8462a00640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f846414ff70 0x7f84640ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7f8462a00640 1 -- 172.21.15.17:0/1374132097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84640c7ce0 msgr2=0x7f8464155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7f8462a00640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84640c7ce0 0x7f8464155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7f8462a00640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8464150bf0 con 0x7f846414fb90 2024-03-19T06:07:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.964+0000 7fae7d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae780ca610 0x7fae781f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.967+0000 7fae7d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae780ca610 0x7fae781f7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41356/0 (socket says 172.21.15.17:41356) 2024-03-19T06:07:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.967+0000 7fae7d000640 1 -- 172.21.15.17:0/2622403515 learned_addr learned my addr 172.21.15.17:0/2622403515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.967+0000 7f1ad3400640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 0x7f1ad4150380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400b490 tx=0x7f1ac400b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.970+0000 7fae77e00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae780cb400 0x7fae780cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.971+0000 7f8462a00640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 0x7f8464154080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f845400c400 tx=0x7f845400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.978+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454017070 con 0x7f846414fb90 2024-03-19T06:07:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.978+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454005ce0 con 0x7f846414fb90 2024-03-19T06:07:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.978+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454007310 con 0x7f846414fb90 2024-03-19T06:07:34.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.978+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84641556a0 con 0x7f846414fb90 2024-03-19T06:07:34.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.978+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8464157540 con 0x7f846414fb90 2024-03-19T06:07:34.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.979+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84641545c0 con 0x7f846414fb90 2024-03-19T06:07:34.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.979+0000 7fae7da00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae78153e90 0x7fae7815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.981+0000 7fae77e00640 1 -- 172.21.15.17:0/2622403515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae78153e90 msgr2=0x7fae7815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.981+0000 7fae77e00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fae78153e90 0x7fae7815c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.981+0000 7fae77e00640 1 -- 172.21.15.17:0/2622403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae780ca610 msgr2=0x7fae781f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.981+0000 7fae77e00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae780ca610 0x7fae781f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.981+0000 7fae77e00640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae781f7780 con 0x7fae780cb400 2024-03-19T06:07:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.984+0000 7fb16ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb16804f2f0 0x7fb1680dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.985+0000 7fb16fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 0x7fb1680c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.987+0000 7fb16fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 0x7fb1680c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49582/0 (socket says 172.21.15.17:49582) 2024-03-19T06:07:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.987+0000 7fb16fe00640 1 -- 172.21.15.17:0/2389822479 learned_addr learned my addr 172.21.15.17:0/2389822479 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.988+0000 7fb96b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb96c0c7570 0x7fb96c15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.991+0000 7fb970a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb96c1586a0 0x7fb96c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.992+0000 7fb96b400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb96c0c7570 0x7fb96c15dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49592/0 (socket says 172.21.15.17:49592) 2024-03-19T06:07:34.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.992+0000 7fb96b400640 1 -- 172.21.15.17:0/3276741876 learned_addr learned my addr 172.21.15.17:0/3276741876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:34.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.992+0000 7fae77e00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae780cb400 0x7fae780cf090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e880 tx=0x7fae6400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:34.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:34.995+0000 7fb16f400640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1680476c0 0x7fb1680cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.001+0000 7fb16fe00640 1 -- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1680476c0 msgr2=0x7fb1680cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.001+0000 7fb16fe00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1680476c0 0x7fb1680cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.001+0000 7fb16fe00640 1 -- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb16804f2f0 msgr2=0x7fb1680dfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.001+0000 7fb16fe00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb16804f2f0 0x7fb1680dfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.001+0000 7fb16fe00640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680cb350 con 0x7fb1680d7090 2024-03-19T06:07:34.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7fb970a00640 1 -- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb96c0c7570 msgr2=0x7fb96c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7fb970a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb96c0c7570 0x7fb96c15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7fb970a00640 1 -- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c06e720 msgr2=0x7fb96c1f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:34.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7fb970a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb96c06e720 0x7fb96c1f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:34.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7fb970a00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c15c0b0 con 0x7fb96c1586a0 2024-03-19T06:07:34.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.007+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f845401a070 con 0x7f846414fb90 2024-03-19T06:07:34.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.008+0000 7f845b400640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f844406bc20 0x7f844406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.008+0000 7f8463400640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f844406bc20 0x7f844406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7520017070 con 0x7f752404b090 2024-03-19T06:07:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75200035f0 con 0x7f752404b090 2024-03-19T06:07:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75200039e0 con 0x7f752404b090 2024-03-19T06:07:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f8463400640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f844406bc20 0x7f844406e0e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8450039000 tx=0x7f845000a040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240cd680 con 0x7f752404b090 2024-03-19T06:07:35.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.009+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75241729e0 con 0x7f752404b090 2024-03-19T06:07:35.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.010+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7524005390 con 0x7f752404b090 2024-03-19T06:07:35.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.015+0000 7f202a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202c1541d0 0x7f202c1f0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.017+0000 7f80c8a00640 1 -- 172.21.15.17:0/2565687774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4034070 con 0x7f80cc070d30 2024-03-19T06:07:35.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.017+0000 7f80c8a00640 1 -- 172.21.15.17:0/2565687774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4030860 con 0x7f80cc070d30 2024-03-19T06:07:35.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.017+0000 7f80c8a00640 1 -- 172.21.15.17:0/2565687774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4030c30 con 0x7f80cc070d30 2024-03-19T06:07:35.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 -- 172.21.15.17:0/2565687774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc070d30 msgr2=0x7f80cc071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 --2- 172.21.15.17:0/2565687774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc070d30 0x7f80cc071140 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c402b9a0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8454056a70 con 0x7f846414fb90 2024-03-19T06:07:35.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 -- 172.21.15.17:0/2565687774 shutdown_connections 2024-03-19T06:07:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 --2- 172.21.15.17:0/2565687774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc070d30 0x7f80cc071140 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 -- 172.21.15.17:0/2565687774 >> 172.21.15.17:0/2565687774 conn(0x7f80cc0c8910 msgr2=0x7f80cc0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 -- 172.21.15.17:0/2565687774 shutdown_connections 2024-03-19T06:07:35.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f80d1200640 1 -- 172.21.15.17:0/2565687774 wait complete. 2024-03-19T06:07:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f845b400640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f8444075630 0x7f8444077ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84440781a0 con 0x7f8444075630 2024-03-19T06:07:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.018+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8454054c70 con 0x7f846414fb90 2024-03-19T06:07:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.019+0000 7f8463e00640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f8444075630 0x7f8444077ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.019+0000 7f8463e00640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f8444075630 0x7f8444077ad0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4015020 con 0x7f1ad414ff70 2024-03-19T06:07:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4011850 con 0x7f1ad414ff70 2024-03-19T06:07:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4011c40 con 0x7f1ad414ff70 2024-03-19T06:07:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad41f35a0 con 0x7f1ad414ff70 2024-03-19T06:07:35.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad41f3b60 con 0x7f1ad414ff70 2024-03-19T06:07:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f202a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202c1541d0 0x7f202c1f0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41388/0 (socket says 172.21.15.17:41388) 2024-03-19T06:07:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.020+0000 7f202a800640 1 -- 172.21.15.17:0/2917409266 learned_addr learned my addr 172.21.15.17:0/2917409266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7f80d1200640 1 Processor -- start 2024-03-19T06:07:35.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7fb16fe00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 0x7fb1680c9660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c3c0 tx=0x7fb15c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7f80d1200640 1 -- start start 2024-03-19T06:07:35.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7fb970a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb96c1586a0 0x7fb96c156f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ec00 tx=0x7fb96400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1aac001030 con 0x7f1ad414ff70 2024-03-19T06:07:35.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.021+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== osd.0 v2:172.21.15.17:6816/3775910215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f84440781a0 con 0x7f8444075630 2024-03-19T06:07:35.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80cc070d30 0x7f80cc15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80cc153ed0 0x7f80cc15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64017070 con 0x7fae780cb400 2024-03-19T06:07:35.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400c940 con 0x7fae780cb400 2024-03-19T06:07:35.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 0x7f80cc1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc071680 con 0x7f80cc15aa00 2024-03-19T06:07:35.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc15de60 con 0x7f80cc153ed0 2024-03-19T06:07:35.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6400cd10 con 0x7fae780cb400 2024-03-19T06:07:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f80d1200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc06ee30 con 0x7f80cc070d30 2024-03-19T06:07:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7f2029e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202c0cb2d0 0x7f202c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae781e4e30 con 0x7fae780cb400 2024-03-19T06:07:35.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.022+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae781e5900 con 0x7fae780cb400 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.023+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae7804f050 con 0x7fae780cb400 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.027+0000 7f2029e00640 1 -- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c0cb8d0 msgr2=0x7f202c151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.027+0000 7f2029e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f202c0cb8d0 0x7f202c151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.027+0000 7f2029e00640 1 -- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202c1541d0 msgr2=0x7f202c1f0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.027+0000 7f2029e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f202c1541d0 0x7f202c1f0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.027+0000 7f2029e00640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c153480 con 0x7f202c0cb2d0 2024-03-19T06:07:35.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.038+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 --> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f846404f050 con 0x7f8444075630 2024-03-19T06:07:35.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f845b400640 1 -- 172.21.15.17:0/1374132097 <== osd.0 v2:172.21.15.17:6816/3775910215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f846404f050 con 0x7f8444075630 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f8444075630 msgr2=0x7f8444077ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f8444075630 0x7f8444077ad0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f844406bc20 msgr2=0x7f844406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f844406bc20 0x7f844406e0e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8450039000 tx=0x7f845000a040 comp rx=0 tx=0).stop 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 msgr2=0x7f8464154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 --2- 172.21.15.17:0/1374132097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f846414fb90 0x7f8464154080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f845400c400 tx=0x7f845400c8c0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8463e00640 1 -- 172.21.15.17:0/1374132097 reap_dead start 2024-03-19T06:07:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.039+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 shutdown_connections 2024-03-19T06:07:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.040+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 >> 172.21.15.17:0/1374132097 conn(0x7f846406e630 msgr2=0x7f84640c5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.040+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 shutdown_connections 2024-03-19T06:07:35.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.040+0000 7f8469000640 1 -- 172.21.15.17:0/1374132097 wait complete. 2024-03-19T06:07:35.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.048+0000 7f2029e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202c0cb2d0 0x7f202c1565e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f201c033000 tx=0x7f201c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.053+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96400cb20 con 0x7fb96c1586a0 2024-03-19T06:07:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.054+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96400ccc0 con 0x7fb96c1586a0 2024-03-19T06:07:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.054+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964003b90 con 0x7fb96c1586a0 2024-03-19T06:07:35.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.054+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96c15c390 con 0x7fb96c1586a0 2024-03-19T06:07:35.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.054+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c15c950 con 0x7fb96c1586a0 2024-03-19T06:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:35.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-19T06:07:35.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.055+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb96c0c9460 con 0x7fb96c1586a0 2024-03-19T06:07:35.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.064+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fae6401a070 con 0x7fae780cb400 2024-03-19T06:07:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.065+0000 7fae74c00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fae5806bc20 0x7fae5806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.066+0000 7fae7d000640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fae5806bc20 0x7fae5806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.066+0000 7fae7d000640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fae5806bc20 0x7fae5806e0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae6c02b880 tx=0x7fae6c03d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.069+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fae64057140 con 0x7fae780cb400 2024-03-19T06:07:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.070+0000 7fae74c00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7fae58075630 0x7fae58077ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.070+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae580781a0 con 0x7fae58075630 2024-03-19T06:07:35.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.070+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae64055340 con 0x7fae780cb400 2024-03-19T06:07:35.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.070+0000 7fae7da00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7fae58075630 0x7fae58077ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.071+0000 7fae7da00640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7fae58075630 0x7fae58077ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.072+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== osd.3 v2:172.21.15.17:6808/439475340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fae580781a0 con 0x7fae58075630 2024-03-19T06:07:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.076+0000 7f80c9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80cc153ed0 0x7f80cc15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.087+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1ac4018020 con 0x7f1ad414ff70 2024-03-19T06:07:35.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.088+0000 7f1acaa00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1ab406bbd0 0x7f1ab406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.088+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 --> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae780caca0 con 0x7fae58075630 2024-03-19T06:07:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.088+0000 7f1ad2a00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1ab406bbd0 0x7f1ab406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.088+0000 7fae74c00640 1 -- 172.21.15.17:0/2622403515 <== osd.3 v2:172.21.15.17:6808/439475340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae780caca0 con 0x7fae58075630 2024-03-19T06:07:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7fae58075630 msgr2=0x7fae58077ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7fae58075630 0x7fae58077ad0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fae5806bc20 msgr2=0x7fae5806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fae5806bc20 0x7fae5806e0e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae6c02b880 tx=0x7fae6c03d040 comp rx=0 tx=0).stop 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae780cb400 msgr2=0x7fae780cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 --2- 172.21.15.17:0/2622403515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae780cb400 0x7fae780cf090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae6400e880 tx=0x7fae6400ed40 comp rx=0 tx=0).stop 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7da00640 1 -- 172.21.15.17:0/2622403515 reap_dead start 2024-03-19T06:07:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7f1ad2a00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1ab406bbd0 0x7f1ab406e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0037000 tx=0x7f1ac0030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 shutdown_connections 2024-03-19T06:07:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 >> 172.21.15.17:0/2622403515 conn(0x7fae7806b540 msgr2=0x7fae7814f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 shutdown_connections 2024-03-19T06:07:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.089+0000 7fae7e400640 1 -- 172.21.15.17:0/2622403515 wait complete. 2024-03-19T06:07:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.093+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1ac4011de0 con 0x7f1ad414ff70 2024-03-19T06:07:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.093+0000 7f1acaa00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7f1ab4075560 0x7f1ab4077a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.093+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1ac4006730 con 0x7f1ab4075560 2024-03-19T06:07:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.093+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ac40555b0 con 0x7f1ad414ff70 2024-03-19T06:07:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.094+0000 7f1ad2000640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7f1ab4075560 0x7f1ab4077a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f1ad2000640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7f1ab4075560 0x7f1ab4077a00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c048070 con 0x7f202c0cb2d0 2024-03-19T06:07:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c039d10 con 0x7f202c0cb2d0 2024-03-19T06:07:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c034040 con 0x7f202c0cb2d0 2024-03-19T06:07:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c1f0bb0 con 0x7f202c0cb2d0 2024-03-19T06:07:35.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c153700 con 0x7f202c0cb2d0 2024-03-19T06:07:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.096+0000 7f80c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80cc070d30 0x7f80cc15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.097+0000 7f80ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 0x7f80cc1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.097+0000 7f80ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 0x7f80cc1f3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47452/0 (socket says 172.21.15.17:47452) 2024-03-19T06:07:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.097+0000 7f80ca800640 1 -- 172.21.15.17:0/2319894411 learned_addr learned my addr 172.21.15.17:0/2319894411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.097+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f202c154740 con 0x7f202c0cb2d0 2024-03-19T06:07:35.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.098+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== osd.5 v2:172.21.15.153:6808/1960976366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1ac4006730 con 0x7f1ab4075560 2024-03-19T06:07:35.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f752001a070 con 0x7f752404b090 2024-03-19T06:07:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f80ca800640 1 -- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80cc070d30 msgr2=0x7f80cc15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f80ca800640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f80cc070d30 0x7f80cc15bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f80ca800640 1 -- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80cc153ed0 msgr2=0x7f80cc15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f80ca800640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80cc153ed0 0x7f80cc15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.101+0000 7f80ca800640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc158460 con 0x7f80cc15aa00 2024-03-19T06:07:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.103+0000 7f7529600640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f751006bc20 0x7f751006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.103+0000 7f7531800640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f751006bc20 0x7f751006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.104+0000 7f7531800640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f751006bc20 0x7f751006e0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f752c0647e0 tx=0x7f752c067a70 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.105+0000 7f80ca800640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 0x7f80cc1f3860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout:68719476757 2024-03-19T06:07:35.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-19T06:07:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.112+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7520056a40 con 0x7f752404b090 2024-03-19T06:07:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.112+0000 7f7529600640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f75100755b0 0x7f7510077a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.112+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f752000ae50 con 0x7f75100755b0 2024-03-19T06:07:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.112+0000 7f7532200640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f75100755b0 0x7f7510077a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.113+0000 7f7532200640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f75100755b0 0x7f7510077a50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.115+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== osd.2 v2:172.21.15.17:6800/4048444499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f752000ae50 con 0x7f75100755b0 2024-03-19T06:07:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.117+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7520054c40 con 0x7f752404b090 2024-03-19T06:07:35.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.118+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 --> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1aac002dd0 con 0x7f1ab4075560 2024-03-19T06:07:35.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7f1acaa00640 1 -- 172.21.15.17:0/614250621 <== osd.5 v2:172.21.15.153:6808/1960976366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1aac002dd0 con 0x7f1ab4075560 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c017070 con 0x7fb1680d7090 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15c0035f0 con 0x7fb1680d7090 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0039e0 con 0x7fb1680d7090 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4048070 con 0x7f80cc15aa00 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c4030660 con 0x7f80cc15aa00 2024-03-19T06:07:35.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4034040 con 0x7f80cc15aa00 2024-03-19T06:07:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1680cb630 con 0x7fb1680d7090 2024-03-19T06:07:35.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.120+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680c8e60 con 0x7fb1680d7090 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7f1ab4075560 msgr2=0x7f1ab4077a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7f1ab4075560 0x7f1ab4077a00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1ab406bbd0 msgr2=0x7f1ab406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1ab406bbd0 0x7f1ab406e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0037000 tx=0x7f1ac0030000 comp rx=0 tx=0).stop 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc15aff0 con 0x7f80cc15aa00 2024-03-19T06:07:35.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc158a00 con 0x7f80cc15aa00 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 msgr2=0x7f1ad4150380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.121+0000 7f1ad3e00640 1 --2- 172.21.15.17:0/614250621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad414ff70 0x7f1ad4150380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400b490 tx=0x7f1ac400b950 comp rx=0 tx=0).stop 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f1ad3400640 1 -- 172.21.15.17:0/614250621 reap_dead start 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 shutdown_connections 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 >> 172.21.15.17:0/614250621 conn(0x7f1ad406e630 msgr2=0x7f1ad40c42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 shutdown_connections 2024-03-19T06:07:35.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1680057e0 con 0x7fb1680d7090 2024-03-19T06:07:35.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f1ad3e00640 1 -- 172.21.15.17:0/614250621 wait complete. 2024-03-19T06:07:35.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.122+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80cc15b970 con 0x7f80cc15aa00 2024-03-19T06:07:35.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.125+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb964005d10 con 0x7fb96c1586a0 2024-03-19T06:07:35.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.127+0000 7fb963e00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb94c06bc20 0x7fb94c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.128+0000 7fb96be00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb94c06bc20 0x7fb94c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.129+0000 7fb96be00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb94c06bc20 0x7fb94c06e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001560 tx=0x7fb95c007990 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.137+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb964057fe0 con 0x7fb96c1586a0 2024-03-19T06:07:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.137+0000 7fb963e00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7fb94c0755c0 0x7fb94c077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.137+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb96400df90 con 0x7fb94c0755c0 2024-03-19T06:07:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.138+0000 7fb96b400640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7fb94c0755c0 0x7fb94c077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.138+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9640561e0 con 0x7fb96c1586a0 2024-03-19T06:07:35.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.139+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 --> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75240cf740 con 0x7f75100755b0 2024-03-19T06:07:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.139+0000 7fb96b400640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7fb94c0755c0 0x7fb94c077a60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7529600640 1 -- 172.21.15.17:0/2824631525 <== osd.2 v2:172.21.15.17:6800/4048444499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75240cf740 con 0x7f75100755b0 2024-03-19T06:07:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f75100755b0 msgr2=0x7f7510077a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f75100755b0 0x7f7510077a50 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f751006bc20 msgr2=0x7f751006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f751006bc20 0x7f751006e0e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f752c0647e0 tx=0x7f752c067a70 comp rx=0 tx=0).stop 2024-03-19T06:07:35.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 msgr2=0x7f7524172f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.140+0000 7f7532c00640 1 --2- 172.21.15.17:0/2824631525 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f752404b090 0x7f7524172f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f752000c470 tx=0x7f752000c930 comp rx=0 tx=0).stop 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.141+0000 7f7532200640 1 -- 172.21.15.17:0/2824631525 reap_dead start 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.141+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 shutdown_connections 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.141+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 >> 172.21.15.17:0/2824631525 conn(0x7f7524050180 msgr2=0x7f75240d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.141+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 shutdown_connections 2024-03-19T06:07:35.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.141+0000 7f7532c00640 1 -- 172.21.15.17:0/2824631525 wait complete. 2024-03-19T06:07:35.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.142+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== osd.7 v2:172.21.15.153:6824/3824547311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb96400df90 con 0x7fb94c0755c0 2024-03-19T06:07:35.135 INFO:teuthology.orchestra.run.smithi017.stdout:68719476758 2024-03-19T06:07:35.135 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-19T06:07:35.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.145+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f201c037070 con 0x7f202c0cb2d0 2024-03-19T06:07:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.145+0000 7f2022000640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f200806bbd0 0x7f200806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.146+0000 7f2023e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f200806bbd0 0x7f200806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.147+0000 7f2023e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f200806bbd0 0x7f200806e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f202c14de10 tx=0x7f2014006c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.149+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f201c079500 con 0x7f202c0cb2d0 2024-03-19T06:07:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.150+0000 7f2022000640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f2008075560 0x7f2008077a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.150+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20080780d0 con 0x7f2008075560 2024-03-19T06:07:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.150+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f201c077700 con 0x7f202c0cb2d0 2024-03-19T06:07:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.150+0000 7f202a800640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f2008075560 0x7f2008077a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.152+0000 7f202a800640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f2008075560 0x7f2008077a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.157+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== osd.4 v2:172.21.15.153:6800/1857527364 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f20080780d0 con 0x7f2008075560 2024-03-19T06:07:35.157 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:35.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-19T06:07:35.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.166+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 --> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb96c0c9fe0 con 0x7fb94c0755c0 2024-03-19T06:07:35.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.168+0000 7fb963e00640 1 -- 172.21.15.17:0/3276741876 <== osd.7 v2:172.21.15.153:6824/3824547311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb96c0c9fe0 con 0x7fb94c0755c0 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.168+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7fb94c0755c0 msgr2=0x7fb94c077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.168+0000 7fb972a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7fb94c0755c0 0x7fb94c077a60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb94c06bc20 msgr2=0x7fb94c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb94c06bc20 0x7fb94c06e0e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001560 tx=0x7fb95c007990 comp rx=0 tx=0).stop 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb96c1586a0 msgr2=0x7fb96c156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 --2- 172.21.15.17:0/3276741876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb96c1586a0 0x7fb96c156f10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb96400ec00 tx=0x7fb96400c490 comp rx=0 tx=0).stop 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb970a00640 1 -- 172.21.15.17:0/3276741876 reap_dead start 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 shutdown_connections 2024-03-19T06:07:35.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 >> 172.21.15.17:0/3276741876 conn(0x7fb96c0c8910 msgr2=0x7fb96c0c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 shutdown_connections 2024-03-19T06:07:35.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.169+0000 7fb972a00640 1 -- 172.21.15.17:0/3276741876 wait complete. 2024-03-19T06:07:35.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.185+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 --> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f202c069be0 con 0x7f2008075560 2024-03-19T06:07:35.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.186+0000 7f2022000640 1 -- 172.21.15.17:0/2917409266 <== osd.4 v2:172.21.15.153:6800/1857527364 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f202c069be0 con 0x7f2008075560 2024-03-19T06:07:35.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.187+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f2008075560 msgr2=0x7f2008077a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.187+0000 7f2030e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f2008075560 0x7f2008077a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f200806bbd0 msgr2=0x7f200806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7f2030e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f200806bbd0 0x7f200806e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f202c14de10 tx=0x7f2014006c90 comp rx=0 tx=0).stop 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202c0cb2d0 msgr2=0x7f202c1565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7f2030e00640 1 --2- 172.21.15.17:0/2917409266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f202c0cb2d0 0x7f202c1565e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f201c033000 tx=0x7f201c004730 comp rx=0 tx=0).stop 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7f202a800640 1 -- 172.21.15.17:0/2917409266 reap_dead start 2024-03-19T06:07:35.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.189+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 shutdown_connections 2024-03-19T06:07:35.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.189+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 >> 172.21.15.17:0/2917409266 conn(0x7f202c06baf0 msgr2=0x7f202c0b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.188+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb15c01a070 con 0x7fb1680d7090 2024-03-19T06:07:35.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.189+0000 7fb163400640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb15006bc20 0x7fb15006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.190+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 shutdown_connections 2024-03-19T06:07:35.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.190+0000 7fb16f400640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb15006bc20 0x7fb15006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.191+0000 7f2030e00640 1 -- 172.21.15.17:0/2917409266 wait complete. 2024-03-19T06:07:35.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.192+0000 7fb16f400640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb15006bc20 0x7fb15006e0e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb17002d400 tx=0x7fb170069990 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.183 INFO:teuthology.orchestra.run.smithi017.stdout:68719476759 2024-03-19T06:07:35.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-19T06:07:35.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.193+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f80c404b070 con 0x7f80cc15aa00 2024-03-19T06:07:35.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.194+0000 7f80c2000640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f80a806bc50 0x7f80a806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.195+0000 7f80c9e00640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f80a806bc50 0x7f80a806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.200+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb15c056a90 con 0x7fb1680d7090 2024-03-19T06:07:35.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.196+0000 7f80c9e00640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f80a806bc50 0x7f80a806e110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.199+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f80c4030810 con 0x7f80cc15aa00 2024-03-19T06:07:35.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.200+0000 7f80c2000640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7f80a8075660 0x7f80a8077b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.200+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80a80781d0 con 0x7f80a8075660 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.200+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80c4077a30 con 0x7f80cc15aa00 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.200+0000 7fb163400640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7fb1500755c0 0x7fb150077a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.201+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb150078130 con 0x7fb1500755c0 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.201+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb15c054c90 con 0x7fb1680d7090 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.201+0000 7f80c9400640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7f80a8075660 0x7f80a8077b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.202+0000 7fb16ea00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7fb1500755c0 0x7fb150077a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.203+0000 7fb16ea00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7fb1500755c0 0x7fb150077a60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.203+0000 7f80c9400640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7f80a8075660 0x7f80a8077b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.205+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== osd.1 v2:172.21.15.17:6818/872185476 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb150078130 con 0x7fb1500755c0 2024-03-19T06:07:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.206+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== osd.6 v2:172.21.15.153:6810/1824749759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f80a80781d0 con 0x7f80a8075660 2024-03-19T06:07:35.208 INFO:teuthology.orchestra.run.smithi017.stdout:68719476757 2024-03-19T06:07:35.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-19T06:07:35.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.233+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 --> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb16804d460 con 0x7fb1500755c0 2024-03-19T06:07:35.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.234+0000 7fb163400640 1 -- 172.21.15.17:0/2389822479 <== osd.1 v2:172.21.15.17:6818/872185476 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb16804d460 con 0x7fb1500755c0 2024-03-19T06:07:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.234+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7fb1500755c0 msgr2=0x7fb150077a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.234+0000 7fb174a00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7fb1500755c0 0x7fb150077a60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb15006bc20 msgr2=0x7fb15006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb15006bc20 0x7fb15006e0e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb17002d400 tx=0x7fb170069990 comp rx=0 tx=0).stop 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 msgr2=0x7fb1680c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 --2- 172.21.15.17:0/2389822479 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb1680d7090 0x7fb1680c9660 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c3c0 tx=0x7fb15c00c880 comp rx=0 tx=0).stop 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb16fe00640 1 -- 172.21.15.17:0/2389822479 reap_dead start 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 shutdown_connections 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.235+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 >> 172.21.15.17:0/2389822479 conn(0x7fb16800e6a0 msgr2=0x7fb168052380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.236+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 shutdown_connections 2024-03-19T06:07:35.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.236+0000 7fb174a00640 1 -- 172.21.15.17:0/2389822479 wait complete. 2024-03-19T06:07:35.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.238+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 --> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80cc0c59b0 con 0x7f80a8075660 2024-03-19T06:07:35.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.243+0000 7f80c2000640 1 -- 172.21.15.17:0/2319894411 <== osd.6 v2:172.21.15.153:6810/1824749759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80cc0c59b0 con 0x7f80a8075660 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.244+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7f80a8075660 msgr2=0x7f80a8077b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.244+0000 7f80d1200640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7f80a8075660 0x7f80a8077b00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f80a806bc50 msgr2=0x7f80a806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f80a806bc50 0x7f80a806e110 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007fd0 tx=0x7f80bc009040 comp rx=0 tx=0).stop 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 msgr2=0x7f80cc1f3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 --2- 172.21.15.17:0/2319894411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80cc15aa00 0x7f80cc1f3860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009870 tx=0x7f80c4004730 comp rx=0 tx=0).stop 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80ca800640 1 -- 172.21.15.17:0/2319894411 reap_dead start 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 shutdown_connections 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 >> 172.21.15.17:0/2319894411 conn(0x7f80cc0c8910 msgr2=0x7f80cc150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 shutdown_connections 2024-03-19T06:07:35.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.245+0000 7f80d1200640 1 -- 172.21.15.17:0/2319894411 wait complete. 2024-03-19T06:07:35.252 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:35.253 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-19T06:07:35.264 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:35.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-19T06:07:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.305+0000 7f75e2400640 1 Processor -- start 2024-03-19T06:07:35.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.305+0000 7f75e2400640 1 -- start start 2024-03-19T06:07:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.307+0000 7f75e2400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.307+0000 7f75e2400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 0x7f75dc0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.307+0000 7f75e2400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc15d3b0 con 0x7f75dc0cb2d0 2024-03-19T06:07:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.307+0000 7f75e2400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc15a0d0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.307+0000 7f75e2400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc15a3b0 con 0x7f75dc1541d0 2024-03-19T06:07:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.315+0000 7f75db400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.317+0000 7f75daa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 0x7f75dc0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.318+0000 7f75daa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 0x7f75dc0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41404/0 (socket says 172.21.15.17:41404) 2024-03-19T06:07:35.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.318+0000 7f75daa00640 1 -- 172.21.15.17:0/751286887 learned_addr learned my addr 172.21.15.17:0/751286887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.336+0000 7f75db400640 1 -- 172.21.15.17:0/751286887 >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 msgr2=0x7f75dc0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.336+0000 7f75db400640 1 --2- 172.21.15.17:0/751286887 >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 0x7f75dc0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.336+0000 7f75db400640 1 -- 172.21.15.17:0/751286887 >> v1:172.21.15.17:6789/0 conn(0x7f75dc0cb2d0 legacy=0x7f75dc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.336+0000 7f75db400640 1 -- 172.21.15.17:0/751286887 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc15a690 con 0x7f75dc1541d0 2024-03-19T06:07:35.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.389+0000 7fd55be00640 1 Processor -- start 2024-03-19T06:07:35.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.393+0000 7fd55be00640 1 -- start start 2024-03-19T06:07:35.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.395+0000 7fd55be00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd55415d860 0x7fd55415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.396+0000 7fd55be00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55415d3b0 con 0x7fd5541541d0 2024-03-19T06:07:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.396+0000 7fd55be00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55415e1d0 con 0x7fd5540cb8d0 2024-03-19T06:07:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.396+0000 7fd55be00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5540ca9b0 con 0x7fd55415d860 2024-03-19T06:07:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.423+0000 7fd558a00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd5540cb8d0 0x7fd5540cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:38374/0 (socket says 172.21.15.17:38374) 2024-03-19T06:07:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.423+0000 7fd558a00640 1 -- 172.21.15.17:0/2416439723 learned_addr learned my addr 172.21.15.17:0/2416439723 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.424+0000 7fd559e00640 1 --2- 172.21.15.17:0/2416439723 >> v2:172.21.15.153:3300/0 conn(0x7fd55415d860 0x7fd55415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.433+0000 7fd553e00640 1 -- 172.21.15.17:0/2416439723 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622070042 0 0) 0x7fd55415d3b0 con 0x7fd5541541d0 2024-03-19T06:07:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.433+0000 7fd553e00640 1 -- 172.21.15.17:0/2416439723 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd53c003520 con 0x7fd5541541d0 2024-03-19T06:07:35.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.433+0000 7fd559e00640 1 -- 172.21.15.17:0/2416439723 >> v1:172.21.15.153:6789/0 conn(0x7fd5540cb8d0 legacy=0x7fd5540cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.434+0000 7fd559e00640 1 -- 172.21.15.17:0/2416439723 >> v1:172.21.15.17:6789/0 conn(0x7fd5541541d0 legacy=0x7fd5540ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.435+0000 7f75db400640 1 --2- 172.21.15.17:0/751286887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc0ca2a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c722b2d251b2fac server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.434+0000 7fd559e00640 1 -- 172.21.15.17:0/2416439723 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55415a0d0 con 0x7fd55415d860 2024-03-19T06:07:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.438+0000 7f7b95a00640 1 Processor -- start 2024-03-19T06:07:35.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.438+0000 7f7b95a00640 1 -- start start 2024-03-19T06:07:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.440+0000 7f7b95a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b900cb8d0 0x7f7b900cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.440+0000 7f7b95a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b900cb2d0 0x7f7b9015d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.440+0000 7f7b95a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9015d3b0 con 0x7f7b901541d0 2024-03-19T06:07:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.440+0000 7f7b95a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b900ca9b0 con 0x7f7b900cb8d0 2024-03-19T06:07:35.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.440+0000 7f7b95a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9015a0d0 con 0x7f7b900cb2d0 2024-03-19T06:07:35.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.442+0000 7f7b86000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b900cb8d0 0x7f7b900cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.442+0000 7f7b86000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b900cb8d0 0x7f7b900cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47464/0 (socket says 172.21.15.17:47464) 2024-03-19T06:07:35.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.442+0000 7f7b86000640 1 -- 172.21.15.17:0/3508658980 learned_addr learned my addr 172.21.15.17:0/3508658980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.445+0000 7f7b86000640 1 -- 172.21.15.17:0/3508658980 >> v2:172.21.15.153:3300/0 conn(0x7f7b900cb2d0 msgr2=0x7f7b9015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.445+0000 7f7b86000640 1 --2- 172.21.15.17:0/3508658980 >> v2:172.21.15.153:3300/0 conn(0x7f7b900cb2d0 0x7f7b9015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.445+0000 7f7b86000640 1 -- 172.21.15.17:0/3508658980 >> v1:172.21.15.17:6789/0 conn(0x7f7b901541d0 legacy=0x7f7b900ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.445+0000 7f7b86000640 1 -- 172.21.15.17:0/3508658980 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9015a3b0 con 0x7f7b900cb8d0 2024-03-19T06:07:35.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.451+0000 7f7b86000640 1 --2- 172.21.15.17:0/3508658980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b900cad90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b900cbf40 tx=0x7f7b7802ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9325216688d8917 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.452+0000 7f75da000640 1 -- 172.21.15.17:0/751286887 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc035020 con 0x7f75dc1541d0 2024-03-19T06:07:35.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.452+0000 7f75da000640 1 -- 172.21.15.17:0/751286887 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc031830 con 0x7f75dc1541d0 2024-03-19T06:07:35.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.452+0000 7f75da000640 1 -- 172.21.15.17:0/751286887 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc031c40 con 0x7f75dc1541d0 2024-03-19T06:07:35.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.453+0000 7f75e2400640 1 -- 172.21.15.17:0/751286887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 msgr2=0x7f75dc0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.453+0000 7f75e2400640 1 --2- 172.21.15.17:0/751286887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc0ca2a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc02b8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 -- 172.21.15.17:0/751286887 shutdown_connections 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 --2- 172.21.15.17:0/751286887 >> v2:172.21.15.153:3300/0 conn(0x7f75dc0cb8d0 0x7f75dc0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 --2- 172.21.15.17:0/751286887 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc0ca2a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 -- 172.21.15.17:0/751286887 >> 172.21.15.17:0/751286887 conn(0x7f75dc06baf0 msgr2=0x7f75dc06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 -- 172.21.15.17:0/751286887 shutdown_connections 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7ff860e00640 1 Processor -- start 2024-03-19T06:07:35.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7fd559e00640 1 --2- 172.21.15.17:0/2416439723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd55415d860 0x7fd55415dc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009d90 tx=0x7fd54c02bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87128f450ab00f0a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7ff860e00640 1 -- start start 2024-03-19T06:07:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.454+0000 7f75e2400640 1 -- 172.21.15.17:0/751286887 wait complete. 2024-03-19T06:07:35.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.456+0000 7f7b8e000640 1 -- 172.21.15.17:0/3508658980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7802f860 con 0x7f7b900cb8d0 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.456+0000 7f7b8e000640 1 -- 172.21.15.17:0/3508658980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7802fa00 con 0x7f7b900cb8d0 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.456+0000 7f7b8e000640 1 -- 172.21.15.17:0/3508658980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7802fdd0 con 0x7f7b900cb8d0 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.456+0000 7f75e2400640 1 Processor -- start 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.456+0000 7ff860e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7ff860e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff85c0cb2d0 0x7ff85c15d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7ff860e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c15d3b0 con 0x7ff85c1541d0 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7ff860e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85c0ca9b0 con 0x7ff85c0cb2d0 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7ff860e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15a0d0 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7f7b95a00640 1 -- 172.21.15.17:0/3508658980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 msgr2=0x7f7b900cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7f7b95a00640 1 --2- 172.21.15.17:0/3508658980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b900cad90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b900cbf40 tx=0x7f7b7802ba40 comp rx=0 tx=0).stop 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 -- 172.21.15.17:0/3508658980 shutdown_connections 2024-03-19T06:07:35.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 --2- 172.21.15.17:0/3508658980 >> v2:172.21.15.153:3300/0 conn(0x7f7b900cb2d0 0x7f7b9015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 --2- 172.21.15.17:0/3508658980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b900cad90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 -- 172.21.15.17:0/3508658980 >> 172.21.15.17:0/3508658980 conn(0x7f7b9006baf0 msgr2=0x7f7b9006bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.457+0000 7f75e2400640 1 -- start start 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc0cb2d0 0x7f75dc146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc15ac50 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc159da0 con 0x7f75dc0cb2d0 2024-03-19T06:07:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f75e2400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0ca7e0 con 0x7f75dc1541d0 2024-03-19T06:07:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 -- 172.21.15.17:0/3508658980 shutdown_connections 2024-03-19T06:07:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.458+0000 7f7b95a00640 1 -- 172.21.15.17:0/3508658980 wait complete. 2024-03-19T06:07:35.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.459+0000 7ff851400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.460+0000 7ff851400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49638/0 (socket says 172.21.15.17:49638) 2024-03-19T06:07:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.460+0000 7ff851400640 1 -- 172.21.15.17:0/1351457960 learned_addr learned my addr 172.21.15.17:0/1351457960 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.461+0000 7f7b95a00640 1 Processor -- start 2024-03-19T06:07:35.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.461+0000 7f7b95a00640 1 -- start start 2024-03-19T06:07:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f75daa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b90159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b901541d0 0x7f7b90154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b90159da0 con 0x7f7b900cb8d0 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9015a970 con 0x7f7b901541d0 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f7b95a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9015ac50 con 0x7f7b900cb2d0 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.462+0000 7f75daa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47472/0 (socket says 172.21.15.17:47472) 2024-03-19T06:07:35.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.463+0000 7f75daa00640 1 -- 172.21.15.17:0/1576390471 learned_addr learned my addr 172.21.15.17:0/1576390471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7f75daa00640 1 -- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 msgr2=0x7f75dc150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7ff851400640 1 -- 172.21.15.17:0/1351457960 >> v2:172.21.15.153:3300/0 conn(0x7ff85c0cb2d0 msgr2=0x7ff85c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7ff851400640 1 --2- 172.21.15.17:0/1351457960 >> v2:172.21.15.153:3300/0 conn(0x7ff85c0cb2d0 0x7ff85c15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7ff851400640 1 -- 172.21.15.17:0/1351457960 >> v1:172.21.15.153:6789/0 conn(0x7ff85c1541d0 legacy=0x7ff85c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7ff851400640 1 -- 172.21.15.17:0/1351457960 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c15a3b0 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7f75daa00640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7f75daa00640 1 -- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc0cb2d0 msgr2=0x7f75dc146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.468+0000 7f75daa00640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc0cb2d0 0x7f75dc146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.469+0000 7f75daa00640 1 -- 172.21.15.17:0/1576390471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc1f7e40 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.473+0000 7f75daa00640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e870 tx=0x7f75c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.475+0000 7f7b8ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.475+0000 7f8988c00640 1 Processor -- start 2024-03-19T06:07:35.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.476+0000 7f8988c00640 1 -- start start 2024-03-19T06:07:35.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89841541d0 0x7f89840ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89840cb8d0 0x7f89840cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89840cb2d0 0x7f898415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898415d3b0 con 0x7f89840cb2d0 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898415a0d0 con 0x7f89840cb8d0 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f8988c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898415a3b0 con 0x7f89841541d0 2024-03-19T06:07:35.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.477+0000 7f7b8f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b901541d0 0x7f7b90154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.479+0000 7f7b8ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49646/0 (socket says 172.21.15.17:49646) 2024-03-19T06:07:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.479+0000 7f7b8ea00640 1 -- 172.21.15.17:0/2731005860 learned_addr learned my addr 172.21.15.17:0/2731005860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f7b86000640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b90159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8017070 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800c8e0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800ccd0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc1f8120 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc1f86e0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f8982800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89840cb2d0 0x7f898415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f8982800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f89840cb2d0 0x7f898415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47498/0 (socket says 172.21.15.17:47498) 2024-03-19T06:07:35.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.480+0000 7f8982800640 1 -- 172.21.15.17:0/3775649340 learned_addr learned my addr 172.21.15.17:0/3775649340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.481+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc069be0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.484+0000 7fd553e00640 1 -- 172.21.15.17:0/2416439723 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c039070 con 0x7fd55415d860 2024-03-19T06:07:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.484+0000 7fd553e00640 1 -- 172.21.15.17:0/2416439723 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c02cda0 con 0x7fd55415d860 2024-03-19T06:07:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.484+0000 7fd553e00640 1 -- 172.21.15.17:0/2416439723 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c034660 con 0x7fd55415d860 2024-03-19T06:07:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.484+0000 7fd55be00640 1 -- 172.21.15.17:0/2416439723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd55415d860 msgr2=0x7fd55415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.484+0000 7fd55be00640 1 --2- 172.21.15.17:0/2416439723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd55415d860 0x7fd55415dc90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009d90 tx=0x7fd54c02bff0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7fd55be00640 1 -- 172.21.15.17:0/2416439723 shutdown_connections 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7fd55be00640 1 --2- 172.21.15.17:0/2416439723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd55415d860 0x7fd55415dc90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7fd55be00640 1 -- 172.21.15.17:0/2416439723 >> 172.21.15.17:0/2416439723 conn(0x7fd55406baf0 msgr2=0x7fd55406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7fd55be00640 1 -- 172.21.15.17:0/2416439723 shutdown_connections 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7fd55be00640 1 -- 172.21.15.17:0/2416439723 wait complete. 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7f8982800640 1 -- 172.21.15.17:0/3775649340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89841541d0 msgr2=0x7f89840ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7f8982800640 1 --2- 172.21.15.17:0/3775649340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89841541d0 0x7f89840ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7f8982800640 1 -- 172.21.15.17:0/3775649340 >> v2:172.21.15.153:3300/0 conn(0x7f89840cb8d0 msgr2=0x7f89840cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7f8982800640 1 --2- 172.21.15.17:0/3775649340 >> v2:172.21.15.153:3300/0 conn(0x7f89840cb8d0 0x7f89840cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.485+0000 7f8982800640 1 -- 172.21.15.17:0/3775649340 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898415a690 con 0x7f89840cb2d0 2024-03-19T06:07:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.487+0000 7fd55be00640 1 Processor -- start 2024-03-19T06:07:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.487+0000 7fd55be00640 1 -- start start 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5541541d0 0x7fd5541f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd55415d860 0x7fd5541f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415a970 con 0x7fd5540cb8d0 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55415a690 con 0x7fd5541541d0 2024-03-19T06:07:35.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.488+0000 7fd55be00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554159da0 con 0x7fd55415d860 2024-03-19T06:07:35.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.490+0000 7f7b8ea00640 1 -- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b901541d0 msgr2=0x7f7b90154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.490+0000 7f7b8ea00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b901541d0 0x7f7b90154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.490+0000 7f7b8ea00640 1 -- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 msgr2=0x7f7b90159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.490+0000 7f7b8ea00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b90159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.490+0000 7f7b8ea00640 1 -- 172.21.15.17:0/2731005860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b901f06f0 con 0x7f7b900cb2d0 2024-03-19T06:07:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.492+0000 7ff851400640 1 --2- 172.21.15.17:0/1351457960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff844009870 tx=0x7ff84402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f71dfc8dc6ff39a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.493+0000 7f8982800640 1 --2- 172.21.15.17:0/3775649340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89840cb2d0 0x7f898415d860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89840d0640 tx=0x7f897c02bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224c733d89126ec2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.501+0000 7f7b8ea00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c760 tx=0x7f7b8000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.504+0000 7fd559400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.514+0000 7fd558a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5541541d0 0x7fd5541f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.518+0000 7fd559400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47508/0 (socket says 172.21.15.17:47508) 2024-03-19T06:07:35.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.518+0000 7fd559400640 1 -- 172.21.15.17:0/1897983275 learned_addr learned my addr 172.21.15.17:0/1897983275 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.520+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f75c801a070 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.521+0000 7f75d3400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 0x7f75bc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.522+0000 7f75db400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 0x7f75bc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.523+0000 7f75db400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 0x7f75bc06e110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75cc036000 tx=0x7f75cc030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.525+0000 7f0720600640 1 Processor -- start 2024-03-19T06:07:35.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.525+0000 7f0720600640 1 -- start start 2024-03-19T06:07:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.526+0000 7ff859400640 1 -- 172.21.15.17:0/1351457960 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844034070 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.526+0000 7ff859400640 1 -- 172.21.15.17:0/1351457960 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844030840 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.526+0000 7ff859400640 1 -- 172.21.15.17:0/1351457960 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff844030c10 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7fd559400640 1 -- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd55415d860 msgr2=0x7fd5541f40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7fd559400640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd55415d860 0x7fd5541f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7fd559400640 1 -- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5541541d0 msgr2=0x7fd5541f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7fd559400640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5541541d0 0x7fd5541f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7fd559400640 1 -- 172.21.15.17:0/1897983275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5541598d0 con 0x7fd5540cb8d0 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7f0720600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07181582d0 0x7f071806fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7f0720600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f07180c8d10 0x7f07180c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7f0720600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0718070350 con 0x7f07180c6fe0 2024-03-19T06:07:35.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7f0720600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07180c9680 con 0x7f07180c8d10 2024-03-19T06:07:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7f0720600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0718071d40 con 0x7f07181582d0 2024-03-19T06:07:35.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.527+0000 7ff860e00640 1 -- 172.21.15.17:0/1351457960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 msgr2=0x7ff85c0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 --2- 172.21.15.17:0/1351457960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff844009870 tx=0x7ff84402b980 comp rx=0 tx=0).stop 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 -- 172.21.15.17:0/1351457960 shutdown_connections 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 --2- 172.21.15.17:0/1351457960 >> v2:172.21.15.153:3300/0 conn(0x7ff85c0cb2d0 0x7ff85c15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 --2- 172.21.15.17:0/1351457960 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c0cad90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 -- 172.21.15.17:0/1351457960 >> 172.21.15.17:0/1351457960 conn(0x7ff85c06baf0 msgr2=0x7ff85c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 -- 172.21.15.17:0/1351457960 shutdown_connections 2024-03-19T06:07:35.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.528+0000 7ff860e00640 1 -- 172.21.15.17:0/1351457960 wait complete. 2024-03-19T06:07:35.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.530+0000 7ff860e00640 1 Processor -- start 2024-03-19T06:07:35.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.530+0000 7ff860e00640 1 -- start start 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85c0cb2d0 0x7ff85c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c159da0 con 0x7ff85c0cb2d0 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15a970 con 0x7ff85c1541d0 2024-03-19T06:07:35.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.531+0000 7ff860e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15ac50 con 0x7ff85c0cb8d0 2024-03-19T06:07:35.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.533+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80016020 con 0x7f7b900cb2d0 2024-03-19T06:07:35.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.533+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80006d50 con 0x7f7b900cb2d0 2024-03-19T06:07:35.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.533+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80003bb0 con 0x7f7b900cb2d0 2024-03-19T06:07:35.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.534+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b901f09d0 con 0x7f7b900cb2d0 2024-03-19T06:07:35.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.534+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9015b430 con 0x7f7b900cb2d0 2024-03-19T06:07:35.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.535+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9015b670 con 0x7f7b900cb2d0 2024-03-19T06:07:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.545+0000 7ff85a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.545+0000 7f071dc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07181582d0 0x7f071806fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.547+0000 7ff85a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41508/0 (socket says 172.21.15.17:41508) 2024-03-19T06:07:35.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.547+0000 7ff85a800640 1 -- 172.21.15.17:0/2216259739 learned_addr learned my addr 172.21.15.17:0/2216259739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.548+0000 7f071dc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f07181582d0 0x7f071806fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41502/0 (socket says 172.21.15.17:41502) 2024-03-19T06:07:35.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.548+0000 7f071dc00640 1 -- 172.21.15.17:0/3008022935 learned_addr learned my addr 172.21.15.17:0/3008022935 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.548+0000 7ff851400640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.560+0000 7ff85a800640 1 -- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 msgr2=0x7ff85c14fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.560+0000 7ff85a800640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c14fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.560+0000 7ff85a800640 1 -- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85c0cb2d0 msgr2=0x7ff85c14d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.560+0000 7ff85a800640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85c0cb2d0 0x7ff85c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.560+0000 7ff85a800640 1 -- 172.21.15.17:0/2216259739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c14d8e0 con 0x7ff85c1541d0 2024-03-19T06:07:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.561+0000 7f764ea00640 1 Processor -- start 2024-03-19T06:07:35.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.561+0000 7f764ea00640 1 -- start start 2024-03-19T06:07:35.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.563+0000 7f764ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f764815b1d0 0x7f76480c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.563+0000 7f764ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76480c1e60 0x7f764806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.563+0000 7f764ea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76480c27c0 con 0x7f7648151f70 2024-03-19T06:07:35.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.563+0000 7f764ea00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7648157f30 con 0x7f764815b1d0 2024-03-19T06:07:35.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.563+0000 7f764ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7648152350 con 0x7f76480c1e60 2024-03-19T06:07:35.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.568+0000 7f071dc00640 1 -- 172.21.15.17:0/3008022935 >> v2:172.21.15.17:3300/0 conn(0x7f07180c8d10 msgr2=0x7f07180c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.568+0000 7f071dc00640 1 --2- 172.21.15.17:0/3008022935 >> v2:172.21.15.17:3300/0 conn(0x7f07180c8d10 0x7f07180c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.568+0000 7f071dc00640 1 -- 172.21.15.17:0/3008022935 >> v1:172.21.15.17:6789/0 conn(0x7f07180c6fe0 legacy=0x7f07180c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.568+0000 7f071dc00640 1 -- 172.21.15.17:0/3008022935 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0718071fe0 con 0x7f07181582d0 2024-03-19T06:07:35.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.569+0000 7f4313c00640 1 Processor -- start 2024-03-19T06:07:35.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.569+0000 7f4313c00640 1 -- start start 2024-03-19T06:07:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.570+0000 7f4313c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f430c1541d0 0x7f430c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.570+0000 7f4313c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f430c15d860 0x7f430c15dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.570+0000 7f4313c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c15d3b0 con 0x7f430c0cb8d0 2024-03-19T06:07:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.570+0000 7f4313c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c15e1d0 con 0x7f430c1541d0 2024-03-19T06:07:35.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.571+0000 7f4313c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c15a0d0 con 0x7f430c15d860 2024-03-19T06:07:35.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.575+0000 7ff85a800640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff854009fd0 tx=0x7ff85400b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.586+0000 7f071dc00640 1 --2- 172.21.15.17:0/3008022935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07181582d0 0x7f071806fcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f071806fa10 tx=0x7f070c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e57395e2792b410 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.591+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854011830 con 0x7ff85c1541d0 2024-03-19T06:07:35.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.591+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff854016070 con 0x7ff85c1541d0 2024-03-19T06:07:35.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.591+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854011bf0 con 0x7ff85c1541d0 2024-03-19T06:07:35.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.591+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c15b6e0 con 0x7ff85c1541d0 2024-03-19T06:07:35.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.591+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c15b9a0 con 0x7ff85c1541d0 2024-03-19T06:07:35.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.592+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c15c620 con 0x7ff85c1541d0 2024-03-19T06:07:35.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.802+0000 7fd559400640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c500 tx=0x7fd54800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.809+0000 7f7647400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f764815b1d0 0x7f76480c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.811+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480052d0 con 0x7fd5540cb8d0 2024-03-19T06:07:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.812+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55414e260 con 0x7fd5540cb8d0 2024-03-19T06:07:35.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.812+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55414e820 con 0x7fd5540cb8d0 2024-03-19T06:07:35.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.813+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd554069be0 con 0x7fd5540cb8d0 2024-03-19T06:07:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.813+0000 7f7647400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f764815b1d0 0x7f76480c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47540/0 (socket says 172.21.15.17:47540) 2024-03-19T06:07:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.813+0000 7f7647400640 1 -- 172.21.15.17:0/2487869751 learned_addr learned my addr 172.21.15.17:0/2487869751 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.814+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548005470 con 0x7fd5540cb8d0 2024-03-19T06:07:35.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.814+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548012850 con 0x7fd5540cb8d0 2024-03-19T06:07:35.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.834+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f75c80575d0 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.835+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f75c8059c30 con 0x7f75dc0cb8d0 2024-03-19T06:07:35.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.841+0000 7f7647400640 1 -- 172.21.15.17:0/2487869751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76480c1e60 msgr2=0x7f764806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.841+0000 7f7647400640 1 --2- 172.21.15.17:0/2487869751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76480c1e60 0x7f764806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.841+0000 7f7647400640 1 -- 172.21.15.17:0/2487869751 >> v1:172.21.15.153:6789/0 conn(0x7f7648151f70 legacy=0x7f76481583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.841+0000 7f7647400640 1 -- 172.21.15.17:0/2487869751 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648157be0 con 0x7f764815b1d0 2024-03-19T06:07:35.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.842+0000 7f8980a00640 1 -- 172.21.15.17:0/3775649340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c02cb40 con 0x7f89840cb2d0 2024-03-19T06:07:35.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.842+0000 7f8980a00640 1 -- 172.21.15.17:0/3775649340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c02cce0 con 0x7f89840cb2d0 2024-03-19T06:07:35.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.842+0000 7f8980a00640 1 -- 172.21.15.17:0/3775649340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c034610 con 0x7f89840cb2d0 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 -- 172.21.15.17:0/3775649340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89840cb2d0 msgr2=0x7f898415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 --2- 172.21.15.17:0/3775649340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89840cb2d0 0x7f898415d860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f89840d0640 tx=0x7f897c02bfa0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 -- 172.21.15.17:0/3775649340 shutdown_connections 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 --2- 172.21.15.17:0/3775649340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89840cb2d0 0x7f898415d860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 --2- 172.21.15.17:0/3775649340 >> v2:172.21.15.153:3300/0 conn(0x7f89840cb8d0 0x7f89840cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 --2- 172.21.15.17:0/3775649340 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89841541d0 0x7f89840ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 -- 172.21.15.17:0/3775649340 >> 172.21.15.17:0/3775649340 conn(0x7f898406baf0 msgr2=0x7f898406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 -- 172.21.15.17:0/3775649340 shutdown_connections 2024-03-19T06:07:35.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.843+0000 7f8988c00640 1 -- 172.21.15.17:0/3775649340 wait complete. 2024-03-19T06:07:35.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.846+0000 7f8988c00640 1 Processor -- start 2024-03-19T06:07:35.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.846+0000 7f8988c00640 1 -- start start 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89840cb8d0 0x7f8984158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89841541d0 0x7f898415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898415ac50 con 0x7f89841541d0 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8984159da0 con 0x7f89840cb8d0 2024-03-19T06:07:35.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.847+0000 7f8988c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89840ca7e0 con 0x7f89840cb2d0 2024-03-19T06:07:35.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.850+0000 7f4311200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f430c1541d0 0x7f430c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.893+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7b8000a850 con 0x7f7b900cb2d0 2024-03-19T06:07:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.894+0000 7f7b87400640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 0x7f7b6c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.894+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7b8008b6d0 con 0x7f7b900cb2d0 2024-03-19T06:07:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.895+0000 7f7b86000640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 0x7f7b6c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.896+0000 7f7b86000640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 0x7f7b6c06e0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b78036000 tx=0x7f7b78008030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.905+0000 7f4311c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f430c15d860 0x7f430c15dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.906+0000 7f8981e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.906+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f7b80020020 con 0x7f7b900cb2d0 2024-03-19T06:07:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.909+0000 7f8981e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49698/0 (socket says 172.21.15.17:49698) 2024-03-19T06:07:35.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.909+0000 7f8981e00640 1 -- 172.21.15.17:0/3151840377 learned_addr learned my addr 172.21.15.17:0/3151840377 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.919+0000 7f8981e00640 1 -- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89840cb8d0 msgr2=0x7f8984158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.919+0000 7f8981e00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89840cb8d0 0x7f8984158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.919+0000 7f8981e00640 1 -- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89841541d0 msgr2=0x7f898415c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.919+0000 7f8981e00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89841541d0 0x7f898415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.919+0000 7f8981e00640 1 -- 172.21.15.17:0/3151840377 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898415afa0 con 0x7f89840cb2d0 2024-03-19T06:07:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.925+0000 7f8981e00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f897400b4d0 tx=0x7f897400b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.933+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974014070 con 0x7f89840cb2d0 2024-03-19T06:07:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.933+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974010870 con 0x7f89840cb2d0 2024-03-19T06:07:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.934+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974010c60 con 0x7f89840cb2d0 2024-03-19T06:07:35.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.934+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898415b280 con 0x7f89840cb2d0 2024-03-19T06:07:35.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.934+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898415b840 con 0x7f89840cb2d0 2024-03-19T06:07:35.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.936+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984069be0 con 0x7f89840cb2d0 2024-03-19T06:07:35.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.948+0000 7f4311c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f430c15d860 0x7f430c15dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41510/0 (socket says 172.21.15.17:41510) 2024-03-19T06:07:35.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.948+0000 7f4311c00640 1 -- 172.21.15.17:0/1099523718 learned_addr learned my addr 172.21.15.17:0/1099523718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:35.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.952+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff85401b460 con 0x7ff85c1541d0 2024-03-19T06:07:35.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.953+0000 7ff852a00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 0x7ff83806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.954+0000 7ff859e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 0x7ff83806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.955+0000 7ff859e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 0x7ff83806e0e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00abb0 tx=0x7ff84c009250 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.961+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff8540576f0 con 0x7ff85c1541d0 2024-03-19T06:07:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.984+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8974017070 con 0x7f89840cb2d0 2024-03-19T06:07:35.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.986+0000 7f897a000640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 0x7f896406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.986+0000 7f8981400640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 0x7f896406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:35.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.988+0000 7f8981400640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 0x7f896406e110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f898415c3d0 tx=0x7f8970006bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:35.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.992+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f89740570a0 con 0x7f89840cb2d0 2024-03-19T06:07:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.995+0000 7f4311c00640 1 -- 172.21.15.17:0/1099523718 >> v2:172.21.15.17:3300/0 conn(0x7f430c1541d0 msgr2=0x7f430c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.995+0000 7f4311c00640 1 --2- 172.21.15.17:0/1099523718 >> v2:172.21.15.17:3300/0 conn(0x7f430c1541d0 0x7f430c0ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.995+0000 7f4311c00640 1 -- 172.21.15.17:0/1099523718 >> v1:172.21.15.17:6789/0 conn(0x7f430c0cb8d0 legacy=0x7f430c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.995+0000 7f4311c00640 1 -- 172.21.15.17:0/1099523718 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c15a3b0 con 0x7f430c15d860 2024-03-19T06:07:35.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:35.996+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7ff85c15c620 con 0x7ff85c1541d0 2024-03-19T06:07:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.001+0000 7f0717e00640 1 -- 172.21.15.17:0/3008022935 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c034070 con 0x7f07181582d0 2024-03-19T06:07:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.002+0000 7f0717e00640 1 -- 172.21.15.17:0/3008022935 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c030860 con 0x7f07181582d0 2024-03-19T06:07:35.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.002+0000 7f0717e00640 1 -- 172.21.15.17:0/3008022935 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c030c30 con 0x7f07181582d0 2024-03-19T06:07:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 -- 172.21.15.17:0/3008022935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07181582d0 msgr2=0x7f071806fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 --2- 172.21.15.17:0/3008022935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07181582d0 0x7f071806fcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f071806fa10 tx=0x7f070c02b9a0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 -- 172.21.15.17:0/3008022935 shutdown_connections 2024-03-19T06:07:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 --2- 172.21.15.17:0/3008022935 >> v2:172.21.15.17:3300/0 conn(0x7f07180c8d10 0x7f07180c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 --2- 172.21.15.17:0/3008022935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07181582d0 0x7f071806fcf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 -- 172.21.15.17:0/3008022935 >> 172.21.15.17:0/3008022935 conn(0x7f0718067430 msgr2=0x7f071806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 -- 172.21.15.17:0/3008022935 shutdown_connections 2024-03-19T06:07:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.003+0000 7f0720600640 1 -- 172.21.15.17:0/3008022935 wait complete. 2024-03-19T06:07:35.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.006+0000 7f0720600640 1 Processor -- start 2024-03-19T06:07:35.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.006+0000 7f0720600640 1 -- start start 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07180c6fe0 0x7f0718151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07181582d0 0x7f0718153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0718072580 con 0x7f07180c6fe0 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07180722a0 con 0x7f07180c8d10 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f0720600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07180c7980 con 0x7f07181582d0 2024-03-19T06:07:35.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.008+0000 7f4311c00640 1 --2- 172.21.15.17:0/1099523718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15d860 0x7f430c15dc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f430c0cbf40 tx=0x7f430402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e53960209ee0b94 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.033+0000 7f071d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.036+0000 7f430b400640 1 -- 172.21.15.17:0/1099523718 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430402cb10 con 0x7f430c15d860 2024-03-19T06:07:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.036+0000 7f430b400640 1 -- 172.21.15.17:0/1099523718 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430402ccb0 con 0x7f430c15d860 2024-03-19T06:07:36.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.036+0000 7f430b400640 1 -- 172.21.15.17:0/1099523718 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430402ce60 con 0x7f430c15d860 2024-03-19T06:07:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.037+0000 7f4313c00640 1 -- 172.21.15.17:0/1099523718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15d860 msgr2=0x7f430c15dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.037+0000 7f4313c00640 1 --2- 172.21.15.17:0/1099523718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15d860 0x7f430c15dc90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f430c0cbf40 tx=0x7f430402bf70 comp rx=0 tx=0).stop 2024-03-19T06:07:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 -- 172.21.15.17:0/1099523718 shutdown_connections 2024-03-19T06:07:36.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 --2- 172.21.15.17:0/1099523718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c15d860 0x7f430c15dc90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 --2- 172.21.15.17:0/1099523718 >> v2:172.21.15.17:3300/0 conn(0x7f430c1541d0 0x7f430c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 -- 172.21.15.17:0/1099523718 >> 172.21.15.17:0/1099523718 conn(0x7f430c06baf0 msgr2=0x7f430c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 -- 172.21.15.17:0/1099523718 shutdown_connections 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f4313c00640 1 -- 172.21.15.17:0/1099523718 wait complete. 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f071d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41534/0 (socket says 172.21.15.17:41534) 2024-03-19T06:07:36.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.038+0000 7f071d200640 1 -- 172.21.15.17:0/3514667650 learned_addr learned my addr 172.21.15.17:0/3514667650 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.041+0000 7f4313c00640 1 Processor -- start 2024-03-19T06:07:36.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.041+0000 7f4313c00640 1 -- start start 2024-03-19T06:07:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c0cb8d0 0x7f430c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c15d860 0x7f430c1f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c159da0 con 0x7f430c0cb8d0 2024-03-19T06:07:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c15a970 con 0x7f430c1541d0 2024-03-19T06:07:36.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.043+0000 7f4313c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c15ac50 con 0x7f430c15d860 2024-03-19T06:07:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.053+0000 7f071d200640 1 -- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07181582d0 msgr2=0x7f0718153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.053+0000 7f071d200640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07181582d0 0x7f0718153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.053+0000 7f071d200640 1 -- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07180c6fe0 msgr2=0x7f0718151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.053+0000 7f071d200640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07180c6fe0 0x7f0718151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.053+0000 7f071d200640 1 -- 172.21.15.17:0/3514667650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07181f73c0 con 0x7f07180c8d10 2024-03-19T06:07:36.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.061+0000 7f071d200640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f070400b3e0 tx=0x7f070400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.072+0000 7f430be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.075+0000 7f430be00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41536/0 (socket says 172.21.15.17:41536) 2024-03-19T06:07:36.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.075+0000 7f430be00640 1 -- 172.21.15.17:0/955341472 learned_addr learned my addr 172.21.15.17:0/955341472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.076+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704015020 con 0x7f07180c8d10 2024-03-19T06:07:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.076+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704011850 con 0x7f07180c8d10 2024-03-19T06:07:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.076+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0704011c40 con 0x7f07180c8d10 2024-03-19T06:07:36.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.076+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071815bf30 con 0x7f07180c8d10 2024-03-19T06:07:36.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.076+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071815c4f0 con 0x7f07180c8d10 2024-03-19T06:07:36.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.077+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0718067d60 con 0x7f07180c8d10 2024-03-19T06:07:36.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.086+0000 7f430be00640 1 -- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c15d860 msgr2=0x7f430c1f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.086+0000 7f430be00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c15d860 0x7f430c1f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.086+0000 7f430be00640 1 -- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c0cb8d0 msgr2=0x7f430c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.086+0000 7f430be00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c0cb8d0 0x7f430c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.086+0000 7f430be00640 1 -- 172.21.15.17:0/955341472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0b4080 con 0x7f430c1541d0 2024-03-19T06:07:36.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.108+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f75dc0c52c0 con 0x7f75dc0cb8d0 2024-03-19T06:07:36.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.116+0000 7f7647400640 1 --2- 172.21.15.17:0/2487869751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764815b1d0 0x7f76480c7760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7634009870 tx=0x7f763402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb30cfc1f6701776 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.162+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7b90069be0 con 0x7f7b900cb2d0 2024-03-19T06:07:36.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.169+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd5480129f0 con 0x7fd5540cb8d0 2024-03-19T06:07:36.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.170+0000 7fd551600640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 0x7fd53806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.170+0000 7fd558a00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 0x7fd53806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.171+0000 7fd558a00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 0x7fd53806e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5541e7340 tx=0x7fd544009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.207+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd5480575b0 con 0x7fd5540cb8d0 2024-03-19T06:07:36.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.208+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff85c069be0 con 0x7ff85c1541d0 2024-03-19T06:07:36.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.208+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fd548059c10 con 0x7fd5540cb8d0 2024-03-19T06:07:36.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.217+0000 7f7646a00640 1 -- 172.21.15.17:0/2487869751 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634034070 con 0x7f764815b1d0 2024-03-19T06:07:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.217+0000 7f7646a00640 1 -- 172.21.15.17:0/2487869751 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634030840 con 0x7f764815b1d0 2024-03-19T06:07:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.217+0000 7f7646a00640 1 -- 172.21.15.17:0/2487869751 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634030c10 con 0x7f764815b1d0 2024-03-19T06:07:36.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 -- 172.21.15.17:0/2487869751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764815b1d0 msgr2=0x7f76480c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 --2- 172.21.15.17:0/2487869751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764815b1d0 0x7f76480c7760 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7634009870 tx=0x7f763402b980 comp rx=0 tx=0).stop 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 -- 172.21.15.17:0/2487869751 shutdown_connections 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 --2- 172.21.15.17:0/2487869751 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f76480c1e60 0x7f764806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 --2- 172.21.15.17:0/2487869751 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f764815b1d0 0x7f76480c7760 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 -- 172.21.15.17:0/2487869751 >> 172.21.15.17:0/2487869751 conn(0x7f76480c8910 msgr2=0x7f76480cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 -- 172.21.15.17:0/2487869751 shutdown_connections 2024-03-19T06:07:36.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.218+0000 7f764ea00640 1 -- 172.21.15.17:0/2487869751 wait complete. 2024-03-19T06:07:36.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.220+0000 7f764ea00640 1 Processor -- start 2024-03-19T06:07:36.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.220+0000 7f764ea00640 1 -- start start 2024-03-19T06:07:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76480c1e60 0x7f76480c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764815b1d0 0x7f76481545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815bcf0 con 0x7f7648151f70 2024-03-19T06:07:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815ba10 con 0x7f76480c1e60 2024-03-19T06:07:36.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.221+0000 7f764ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764815bfd0 con 0x7f764815b1d0 2024-03-19T06:07:36.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.236+0000 7f75d3400640 1 -- 172.21.15.17:0/1576390471 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75c8059530 con 0x7f75dc0cb8d0 2024-03-19T06:07:36.227 INFO:teuthology.orchestra.run.smithi017.stdout:64424509460 2024-03-19T06:07:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.238+0000 7f7647400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.238+0000 7f7647400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47580/0 (socket says 172.21.15.17:47580) 2024-03-19T06:07:36.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.238+0000 7f7647400640 1 -- 172.21.15.17:0/1013555482 learned_addr learned my addr 172.21.15.17:0/1013555482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 msgr2=0x7f75bc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 0x7f75bc06e110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75cc036000 tx=0x7f75cc030000 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 msgr2=0x7f75dc150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f75c800e870 tx=0x7f75c800ed30 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 shutdown_connections 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f75dc1541d0 0x7f75dc150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75dc0cb8d0 0x7f75dc150240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f75bc06bc50 0x7f75bc06e110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 --2- 172.21.15.17:0/1576390471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc0cb2d0 0x7f75dc146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 >> 172.21.15.17:0/1576390471 conn(0x7f75dc06baf0 msgr2=0x7f75dc073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 shutdown_connections 2024-03-19T06:07:36.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.239+0000 7f75e2400640 1 -- 172.21.15.17:0/1576390471 wait complete. 2024-03-19T06:07:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.243+0000 7f7647400640 1 -- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764815b1d0 msgr2=0x7f76481545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.243+0000 7f7647400640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764815b1d0 0x7f76481545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.243+0000 7f7647400640 1 -- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76480c1e60 msgr2=0x7f76480c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.243+0000 7f7647400640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76480c1e60 0x7f76480c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.243+0000 7f7647400640 1 -- 172.21.15.17:0/1013555482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648152cd0 con 0x7f7648151f70 2024-03-19T06:07:36.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.247+0000 7f7647400640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7634000c00 tx=0x7f7634004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.253+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634048070 con 0x7f7648151f70 2024-03-19T06:07:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.253+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7634030640 con 0x7f7648151f70 2024-03-19T06:07:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.253+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7648152fb0 con 0x7f7648151f70 2024-03-19T06:07:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.253+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634034040 con 0x7f7648151f70 2024-03-19T06:07:36.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.253+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7648153570 con 0x7f7648151f70 2024-03-19T06:07:36.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.255+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7648069be0 con 0x7f7648151f70 2024-03-19T06:07:36.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.0 2024-03-19T06:07:36.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.280+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f763404b070 con 0x7f7648151f70 2024-03-19T06:07:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.281+0000 7f763fe00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 0x7f762806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.281+0000 7f7647e00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 0x7f762806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.282+0000 7f7647e00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 0x7f762806e0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7638001560 tx=0x7f7638007990 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.320+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f8974059700 con 0x7f89840cb2d0 2024-03-19T06:07:36.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.356+0000 7f7b87400640 1 -- 172.21.15.17:0/2731005860 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b800598e0 con 0x7f7b900cb2d0 2024-03-19T06:07:36.347 INFO:teuthology.orchestra.run.smithi017.stdout:68719476757 2024-03-19T06:07:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 msgr2=0x7f7b6c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 0x7f7b6c06e0e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7b78036000 tx=0x7f7b78008030 comp rx=0 tx=0).stop 2024-03-19T06:07:36.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 msgr2=0x7f7b9015bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c760 tx=0x7f7b8000cc20 comp rx=0 tx=0).stop 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 shutdown_connections 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6c06bc20 0x7f7b6c06e0e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b901541d0 0x7f7b90154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b900cb8d0 0x7f7b90159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.359+0000 7f7b95a00640 1 --2- 172.21.15.17:0/2731005860 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b900cb2d0 0x7f7b9015bc30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.360+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 >> 172.21.15.17:0/2731005860 conn(0x7f7b9006baf0 msgr2=0x7f7b900c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.360+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 shutdown_connections 2024-03-19T06:07:36.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.360+0000 7f7b95a00640 1 -- 172.21.15.17:0/2731005860 wait complete. 2024-03-19T06:07:36.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.368+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0704018020 con 0x7f07180c8d10 2024-03-19T06:07:36.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.369+0000 7f0715600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 0x7f06f806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.369+0000 7f071dc00640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 0x7f06f806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.370+0000 7f071dc00640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 0x7f06f806e0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f070c036000 tx=0x7f070c03b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.377+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0704011de0 con 0x7f07180c8d10 2024-03-19T06:07:36.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476758 got 68719476757 for osd.5 2024-03-19T06:07:36.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.419+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5540cc6d0 con 0x7fd5540cb8d0 2024-03-19T06:07:36.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.472+0000 7f430be00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c470 tx=0x7f42f800c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.473+0000 7ff852a00640 1 -- 172.21.15.17:0/2216259739 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff854059d50 con 0x7ff85c1541d0 2024-03-19T06:07:36.464 INFO:teuthology.orchestra.run.smithi017.stdout:64424509460 2024-03-19T06:07:36.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 msgr2=0x7ff83806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 0x7ff83806e0e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00abb0 tx=0x7ff84c009250 comp rx=0 tx=0).stop 2024-03-19T06:07:36.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 msgr2=0x7ff85c150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff854009fd0 tx=0x7ff85400b8e0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 shutdown_connections 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff83806bc20 0x7ff83806e0e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff85c1541d0 0x7ff85c150180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff85c0cb8d0 0x7ff85c14fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 --2- 172.21.15.17:0/2216259739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff85c0cb2d0 0x7ff85c14d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.475+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 >> 172.21.15.17:0/2216259739 conn(0x7ff85c06baf0 msgr2=0x7ff85c0c5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.476+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 shutdown_connections 2024-03-19T06:07:36.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.476+0000 7ff860e00640 1 -- 172.21.15.17:0/2216259739 wait complete. 2024-03-19T06:07:36.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.488+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f76340307f0 con 0x7f7648151f70 2024-03-19T06:07:36.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.2 2024-03-19T06:07:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.521+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8017070 con 0x7f430c1541d0 2024-03-19T06:07:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.521+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f80035f0 con 0x7f430c1541d0 2024-03-19T06:07:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.521+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f80039e0 con 0x7f430c1541d0 2024-03-19T06:07:36.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.521+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c15b380 con 0x7f430c1541d0 2024-03-19T06:07:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.522+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c15ca90 con 0x7f430c1541d0 2024-03-19T06:07:36.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.522+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f070401f020 con 0x7f07180c8d10 2024-03-19T06:07:36.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.524+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c069be0 con 0x7f430c1541d0 2024-03-19T06:07:36.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.528+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f89840b3aa0 con 0x7f89840cb2d0 2024-03-19T06:07:36.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.545+0000 7f897a000640 1 -- 172.21.15.17:0/3151840377 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8974059000 con 0x7f89840cb2d0 2024-03-19T06:07:36.535 INFO:teuthology.orchestra.run.smithi017.stdout:68719476758 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 msgr2=0x7f896406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 0x7f896406e110 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f898415c3d0 tx=0x7f8970006bf0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 msgr2=0x7f89841f0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f897400b4d0 tx=0x7f897400b990 comp rx=0 tx=0).stop 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 shutdown_connections 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89841541d0 0x7f898415c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f896406bc50 0x7f896406e110 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89840cb8d0 0x7f8984158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 --2- 172.21.15.17:0/3151840377 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f89840cb2d0 0x7f89841f0e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 >> 172.21.15.17:0/3151840377 conn(0x7f898406baf0 msgr2=0x7f89840c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 shutdown_connections 2024-03-19T06:07:36.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.547+0000 7f8988c00640 1 -- 172.21.15.17:0/3151840377 wait complete. 2024-03-19T06:07:36.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476758 for osd.7 2024-03-19T06:07:36.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.567+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f7634052020 con 0x7f7648151f70 2024-03-19T06:07:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.685+0000 7fd551600640 1 -- 172.21.15.17:0/1897983275 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd548059510 con 0x7fd5540cb8d0 2024-03-19T06:07:36.676 INFO:teuthology.orchestra.run.smithi017.stdout:68719476756 2024-03-19T06:07:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 msgr2=0x7fd53806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 0x7fd53806e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd5541e7340 tx=0x7fd544009040 comp rx=0 tx=0).stop 2024-03-19T06:07:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 msgr2=0x7fd5540cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd54800c500 tx=0x7fd54800c9c0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 shutdown_connections 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd55415d860 0x7fd5541f40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd53806bbd0 0x7fd53806e090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5541541d0 0x7fd5541f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 --2- 172.21.15.17:0/1897983275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5540cb8d0 0x7fd5540cf760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 >> 172.21.15.17:0/1897983275 conn(0x7fd55406baf0 msgr2=0x7fd5540c58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.688+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 shutdown_connections 2024-03-19T06:07:36.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.689+0000 7fd55be00640 1 -- 172.21.15.17:0/1897983275 wait complete. 2024-03-19T06:07:36.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.3 2024-03-19T06:07:36.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.752+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0718074a20 con 0x7f07180c8d10 2024-03-19T06:07:36.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.762+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f76480c6a00 con 0x7f7648151f70 2024-03-19T06:07:36.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.769+0000 7f763fe00640 1 -- 172.21.15.17:0/1013555482 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f763407bbc0 con 0x7f7648151f70 2024-03-19T06:07:36.759 INFO:teuthology.orchestra.run.smithi017.stdout:64424509460 2024-03-19T06:07:36.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 msgr2=0x7f762806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 0x7f762806e0e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7638001560 tx=0x7f7638007990 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 msgr2=0x7f7648159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7634000c00 tx=0x7f7634004730 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 shutdown_connections 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f764815b1d0 0x7f76481545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7648151f70 0x7f7648159600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f762806bc20 0x7f762806e0e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 --2- 172.21.15.17:0/1013555482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76480c1e60 0x7f76480c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 >> 172.21.15.17:0/1013555482 conn(0x7f76480c8910 msgr2=0x7f7648156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.771+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 shutdown_connections 2024-03-19T06:07:36.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.772+0000 7f764ea00640 1 -- 172.21.15.17:0/1013555482 wait complete. 2024-03-19T06:07:36.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.6 2024-03-19T06:07:36.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.862+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f42f801a070 con 0x7f430c1541d0 2024-03-19T06:07:36.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.864+0000 7f4308c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 0x7f42ec06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:36.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.865+0000 7f4311200640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 0x7f42ec06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:36.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.867+0000 7f4311200640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 0x7f42ec06e0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4300006fd0 tx=0x7f4300008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:36.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.871+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f42f8056720 con 0x7f430c1541d0 2024-03-19T06:07:36.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:36.899+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f42f8021020 con 0x7f430c1541d0 2024-03-19T06:07:37.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.107+0000 7f0715600640 1 -- 172.21.15.17:0/3514667650 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f070400f2e0 con 0x7f07180c8d10 2024-03-19T06:07:37.098 INFO:teuthology.orchestra.run.smithi017.stdout:68719476756 2024-03-19T06:07:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.109+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 msgr2=0x7f06f806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.109+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 0x7f06f806e0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f070c036000 tx=0x7f070c03b040 comp rx=0 tx=0).stop 2024-03-19T06:07:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 msgr2=0x7f071815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f070400b3e0 tx=0x7f070400b8a0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 shutdown_connections 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f07181582d0 0x7f0718153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f06f806bc20 0x7f06f806e0e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07180c8d10 0x7f071815def0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 --2- 172.21.15.17:0/3514667650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f07180c6fe0 0x7f0718151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 >> 172.21.15.17:0/3514667650 conn(0x7f0718067430 msgr2=0x7f07180727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 shutdown_connections 2024-03-19T06:07:37.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.110+0000 7f0720600640 1 -- 172.21.15.17:0/3514667650 wait complete. 2024-03-19T06:07:37.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.117+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f430c0cab70 con 0x7f430c1541d0 2024-03-19T06:07:37.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.126+0000 7f4308c00640 1 -- 172.21.15.17:0/955341472 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42f8058d80 con 0x7f430c1541d0 2024-03-19T06:07:37.116 INFO:teuthology.orchestra.run.smithi017.stdout:64424509460 2024-03-19T06:07:37.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.4 2024-03-19T06:07:37.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 msgr2=0x7f42ec06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 0x7f42ec06e0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4300006fd0 tx=0x7f4300008040 comp rx=0 tx=0).stop 2024-03-19T06:07:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 msgr2=0x7f430c0cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c470 tx=0x7f42f800c930 comp rx=0 tx=0).stop 2024-03-19T06:07:37.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 shutdown_connections 2024-03-19T06:07:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f430c15d860 0x7f430c1f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f42ec06bc20 0x7f42ec06e0e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f430c1541d0 0x7f430c0cf760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 --2- 172.21.15.17:0/955341472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f430c0cb8d0 0x7f430c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.129+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 >> 172.21.15.17:0/955341472 conn(0x7f430c06baf0 msgr2=0x7f430c0cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.130+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 shutdown_connections 2024-03-19T06:07:37.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.130+0000 7f4313c00640 1 -- 172.21.15.17:0/955341472 wait complete. 2024-03-19T06:07:37.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.1 2024-03-19T06:07:37.249 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-19T06:07:37.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-19T06:07:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.475+0000 7fbecd400640 1 Processor -- start 2024-03-19T06:07:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.475+0000 7fbecd400640 1 -- start start 2024-03-19T06:07:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.476+0000 7fbecd400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 0x7fbec80ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.477+0000 7fbecd400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbec815d860 0x7fbec815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.477+0000 7fbecd400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec815d3b0 con 0x7fbec80cb8d0 2024-03-19T06:07:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.477+0000 7fbecd400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec815e1d0 con 0x7fbec815d860 2024-03-19T06:07:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.477+0000 7fbecd400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec815a0d0 con 0x7fbec81541d0 2024-03-19T06:07:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.478+0000 7fbec6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 0x7fbec80ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.479+0000 7fbec6800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 0x7fbec80ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41542/0 (socket says 172.21.15.17:41542) 2024-03-19T06:07:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.479+0000 7fbec6800640 1 -- 172.21.15.17:0/2677852445 learned_addr learned my addr 172.21.15.17:0/2677852445 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.480+0000 7fbec7200640 1 --2- 172.21.15.17:0/2677852445 >> v2:172.21.15.17:3300/0 conn(0x7fbec815d860 0x7fbec815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.484+0000 7fbec7200640 1 -- 172.21.15.17:0/2677852445 >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 msgr2=0x7fbec80ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.484+0000 7fbec7200640 1 --2- 172.21.15.17:0/2677852445 >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 0x7fbec80ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.484+0000 7fbec7200640 1 -- 172.21.15.17:0/2677852445 >> v1:172.21.15.17:6789/0 conn(0x7fbec80cb8d0 legacy=0x7fbec80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.484+0000 7fbec7200640 1 -- 172.21.15.17:0/2677852445 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec815a3b0 con 0x7fbec815d860 2024-03-19T06:07:37.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.490+0000 7fbec7200640 1 --2- 172.21.15.17:0/2677852445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec815d860 0x7fbec815dc90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbec808cb70 tx=0x7fbec002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63975af63d4ddb82 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-19T06:07:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.494+0000 7fbec5e00640 1 -- 172.21.15.17:0/2677852445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0039070 con 0x7fbec815d860 2024-03-19T06:07:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.495+0000 7fbec5e00640 1 -- 172.21.15.17:0/2677852445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec002cd00 con 0x7fbec815d860 2024-03-19T06:07:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.495+0000 7fbec5e00640 1 -- 172.21.15.17:0/2677852445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0034660 con 0x7fbec815d860 2024-03-19T06:07:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.495+0000 7fbecd400640 1 -- 172.21.15.17:0/2677852445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec815d860 msgr2=0x7fbec815dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.495+0000 7fbecd400640 1 --2- 172.21.15.17:0/2677852445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec815d860 0x7fbec815dc90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbec808cb70 tx=0x7fbec002bf50 comp rx=0 tx=0).stop 2024-03-19T06:07:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 -- 172.21.15.17:0/2677852445 shutdown_connections 2024-03-19T06:07:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 --2- 172.21.15.17:0/2677852445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec815d860 0x7fbec815dc90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 --2- 172.21.15.17:0/2677852445 >> v2:172.21.15.153:3300/0 conn(0x7fbec81541d0 0x7fbec80ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 -- 172.21.15.17:0/2677852445 >> 172.21.15.17:0/2677852445 conn(0x7fbec806baf0 msgr2=0x7fbec806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 -- 172.21.15.17:0/2677852445 shutdown_connections 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.496+0000 7fbecd400640 1 -- 172.21.15.17:0/2677852445 wait complete. 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.498+0000 7fbecd400640 1 Processor -- start 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.498+0000 7fbecd400640 1 -- start start 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec80cb8d0 0x7fbec814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbec815d860 0x7fbec81f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8159da0 con 0x7fbec81541d0 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec815a970 con 0x7fbec80cb8d0 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.499+0000 7fbecd400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec815ac50 con 0x7fbec815d860 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.500+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.500+0000 7fbec6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec80cb8d0 0x7fbec814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.500+0000 7fbebfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47596/0 (socket says 172.21.15.17:47596) 2024-03-19T06:07:37.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.500+0000 7fbebfe00640 1 -- 172.21.15.17:0/2589318197 learned_addr learned my addr 172.21.15.17:0/2589318197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.501+0000 7fbec7200640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbec815d860 0x7fbec81f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.505+0000 7fbebfe00640 1 -- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbec815d860 msgr2=0x7fbec81f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.505+0000 7fbebfe00640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbec815d860 0x7fbec81f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.505+0000 7fbebfe00640 1 -- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec80cb8d0 msgr2=0x7fbec814f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.505+0000 7fbebfe00640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec80cb8d0 0x7fbec814f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.505+0000 7fbebfe00640 1 -- 172.21.15.17:0/2589318197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80ca570 con 0x7fbec81541d0 2024-03-19T06:07:37.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.508+0000 7fbebfe00640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c430 tx=0x7fbeb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.513+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb00052d0 con 0x7fbec81541d0 2024-03-19T06:07:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.513+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0005490 con 0x7fbec81541d0 2024-03-19T06:07:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.513+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0007260 con 0x7fbec81541d0 2024-03-19T06:07:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.513+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec81eff40 con 0x7fbec81541d0 2024-03-19T06:07:37.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.513+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec814e110 con 0x7fbec81541d0 2024-03-19T06:07:37.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.515+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec8069be0 con 0x7fbec81541d0 2024-03-19T06:07:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.539+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbeb0007400 con 0x7fbec81541d0 2024-03-19T06:07:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.541+0000 7fbebea00640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 0x7fbea406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.541+0000 7fbec6800640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 0x7fbea406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.542+0000 7fbec6800640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 0x7fbea406e0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009bd0 tx=0x7fbeb8009240 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-19T06:07:37.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.588+0000 7fb431e00640 1 Processor -- start 2024-03-19T06:07:37.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.589+0000 7fb431e00640 1 -- start start 2024-03-19T06:07:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.590+0000 7fb431e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb42c1541d0 0x7fb42c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.590+0000 7fb431e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c15d3b0 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.590+0000 7fb431e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42c15a0d0 con 0x7fb42c15d860 2024-03-19T06:07:37.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.590+0000 7fb431e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42c15a3b0 con 0x7fb42c1541d0 2024-03-19T06:07:37.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.591+0000 7fb42aa00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb42c1541d0 0x7fb42c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.592+0000 7fb42b400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb42c15d860 0x7fb42c15dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:38408/0 (socket says 172.21.15.17:38408) 2024-03-19T06:07:37.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.592+0000 7fb42b400640 1 -- 172.21.15.17:0/2072050709 learned_addr learned my addr 172.21.15.17:0/2072050709 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:37.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.597+0000 7fb42aa00640 1 -- 172.21.15.17:0/2072050709 >> v1:172.21.15.153:6789/0 conn(0x7fb42c15d860 legacy=0x7fb42c15dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.597+0000 7fb42aa00640 1 -- 172.21.15.17:0/2072050709 >> v1:172.21.15.17:6789/0 conn(0x7fb42c0cb8d0 legacy=0x7fb42c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.597+0000 7fb42aa00640 1 -- 172.21.15.17:0/2072050709 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c15a690 con 0x7fb42c1541d0 2024-03-19T06:07:37.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.604+0000 7fb42aa00640 1 --2- 172.21.15.17:0/2072050709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c1541d0 0x7fb42c0ca2a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0097a0 tx=0x7fb41c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7834b3a8b72d2d66 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.613+0000 7fb429600640 1 -- 172.21.15.17:0/2072050709 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c034070 con 0x7fb42c1541d0 2024-03-19T06:07:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.613+0000 7fb429600640 1 -- 172.21.15.17:0/2072050709 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c030610 con 0x7fb42c1541d0 2024-03-19T06:07:37.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.613+0000 7fb429600640 1 -- 172.21.15.17:0/2072050709 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0309e0 con 0x7fb42c1541d0 2024-03-19T06:07:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 -- 172.21.15.17:0/2072050709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c1541d0 msgr2=0x7fb42c0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 --2- 172.21.15.17:0/2072050709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c1541d0 0x7fb42c0ca2a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0097a0 tx=0x7fb41c02b960 comp rx=0 tx=0).stop 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 -- 172.21.15.17:0/2072050709 shutdown_connections 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 --2- 172.21.15.17:0/2072050709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c1541d0 0x7fb42c0ca2a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 -- 172.21.15.17:0/2072050709 >> 172.21.15.17:0/2072050709 conn(0x7fb42c06baf0 msgr2=0x7fb42c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 -- 172.21.15.17:0/2072050709 shutdown_connections 2024-03-19T06:07:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.614+0000 7fb431e00640 1 -- 172.21.15.17:0/2072050709 wait complete. 2024-03-19T06:07:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.617+0000 7fb431e00640 1 Processor -- start 2024-03-19T06:07:37.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.617+0000 7fb431e00640 1 -- start start 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb42c1541d0 0x7fb42c0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c15d860 0x7fb42c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c15ac50 con 0x7fb42c15d860 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c159da0 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.618+0000 7fb431e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42c0cb4a0 con 0x7fb42c1541d0 2024-03-19T06:07:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.620+0000 7fb42aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.620+0000 7fb42aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41562/0 (socket says 172.21.15.17:41562) 2024-03-19T06:07:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.620+0000 7fb42aa00640 1 -- 172.21.15.17:0/3898226432 learned_addr learned my addr 172.21.15.17:0/3898226432 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.620+0000 7fb42a000640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb42c1541d0 0x7fb42c0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.625+0000 7fb42aa00640 1 -- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb42c1541d0 msgr2=0x7fb42c0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.625+0000 7fb42aa00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb42c1541d0 0x7fb42c0ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.626+0000 7fb42aa00640 1 -- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c15d860 msgr2=0x7fb42c14cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.626+0000 7fb42aa00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c15d860 0x7fb42c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.626+0000 7fb42aa00640 1 -- 172.21.15.17:0/3898226432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c15bc20 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.630+0000 7fb42aa00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009890 tx=0x7fb41c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.635+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c034040 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.635+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c15af70 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.635+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c15bec0 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.637+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42c0c9fd0 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.639+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c0305a0 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.639+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c039c60 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.682+0000 7f45e4e00640 1 Processor -- start 2024-03-19T06:07:37.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.683+0000 7f45e4e00640 1 -- start start 2024-03-19T06:07:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.684+0000 7f45e4e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45e00c9410 0x7f45e0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.684+0000 7f45e4e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e015e0b0 con 0x7f45e015b080 2024-03-19T06:07:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.684+0000 7f45e4e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e015a200 con 0x7f45e015dc60 2024-03-19T06:07:37.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.684+0000 7f45e4e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e00caac0 con 0x7f45e00c9410 2024-03-19T06:07:37.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-19T06:07:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.754+0000 7f731fe00640 1 Processor -- start 2024-03-19T06:07:37.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.754+0000 7f731fe00640 1 -- start start 2024-03-19T06:07:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.756+0000 7f731fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7318153d90 0x7f731815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.756+0000 7f731fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.756+0000 7f731fe00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731815d1d0 con 0x7f73180ca580 2024-03-19T06:07:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.756+0000 7f731fe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73180cac30 con 0x7f7318153d90 2024-03-19T06:07:37.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.756+0000 7f731fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731815d450 con 0x7f73180ca140 2024-03-19T06:07:37.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.758+0000 7f731ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.759+0000 7f731ca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49762/0 (socket says 172.21.15.17:49762) 2024-03-19T06:07:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.759+0000 7f731ca00640 1 -- 172.21.15.17:0/2056685645 learned_addr learned my addr 172.21.15.17:0/2056685645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.765+0000 7f731ca00640 1 -- 172.21.15.17:0/2056685645 >> v2:172.21.15.17:3300/0 conn(0x7f7318153d90 msgr2=0x7f731815a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.765+0000 7f731ca00640 1 --2- 172.21.15.17:0/2056685645 >> v2:172.21.15.17:3300/0 conn(0x7f7318153d90 0x7f731815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.765+0000 7f731ca00640 1 -- 172.21.15.17:0/2056685645 >> v1:172.21.15.153:6789/0 conn(0x7f73180ca580 legacy=0x7f73180cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.765+0000 7f731ca00640 1 -- 172.21.15.17:0/2056685645 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731815d730 con 0x7f73180ca140 2024-03-19T06:07:37.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.770+0000 7f731ca00640 1 --2- 172.21.15.17:0/2056685645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73180cadb0 tx=0x7f730402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f1d146a0005ab9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.779+0000 7f7317e00640 1 -- 172.21.15.17:0/2056685645 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304035020 con 0x7f73180ca140 2024-03-19T06:07:37.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.779+0000 7f7317e00640 1 -- 172.21.15.17:0/2056685645 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304031640 con 0x7f73180ca140 2024-03-19T06:07:37.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.779+0000 7f7317e00640 1 -- 172.21.15.17:0/2056685645 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730402d040 con 0x7f73180ca140 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 -- 172.21.15.17:0/2056685645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 msgr2=0x7f731806c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 --2- 172.21.15.17:0/2056685645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73180cadb0 tx=0x7f730402b8f0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 -- 172.21.15.17:0/2056685645 shutdown_connections 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 --2- 172.21.15.17:0/2056685645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f731806c780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 --2- 172.21.15.17:0/2056685645 >> v2:172.21.15.17:3300/0 conn(0x7f7318153d90 0x7f731815a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 -- 172.21.15.17:0/2056685645 >> 172.21.15.17:0/2056685645 conn(0x7f7318066e10 msgr2=0x7f731806bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 -- 172.21.15.17:0/2056685645 shutdown_connections 2024-03-19T06:07:37.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.780+0000 7f731fe00640 1 -- 172.21.15.17:0/2056685645 wait complete. 2024-03-19T06:07:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.782+0000 7f731fe00640 1 Processor -- start 2024-03-19T06:07:37.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.782+0000 7f731fe00640 1 -- start start 2024-03-19T06:07:37.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73180ca580 0x7f731815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7318153d90 0x7f7318151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731815dfd0 con 0x7f73180ca580 2024-03-19T06:07:37.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731815dcf0 con 0x7f7318153d90 2024-03-19T06:07:37.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.783+0000 7f731fe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73180cb7d0 con 0x7f73180ca140 2024-03-19T06:07:37.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.785+0000 7f731d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.786+0000 7f731d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49770/0 (socket says 172.21.15.17:49770) 2024-03-19T06:07:37.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.786+0000 7f731d400640 1 -- 172.21.15.17:0/1955268403 learned_addr learned my addr 172.21.15.17:0/1955268403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-19T06:07:37.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.795+0000 7f731d400640 1 -- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7318153d90 msgr2=0x7f7318151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.795+0000 7f731d400640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7318153d90 0x7f7318151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.795+0000 7f731d400640 1 -- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73180ca580 msgr2=0x7f731815c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.795+0000 7f731d400640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73180ca580 0x7f731815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.795+0000 7f731d400640 1 -- 172.21.15.17:0/1955268403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731815ce60 con 0x7f73180ca140 2024-03-19T06:07:37.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.802+0000 7f731d400640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f730c00b440 tx=0x7f730c00b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.811+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c015020 con 0x7f73180ca140 2024-03-19T06:07:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.811+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c011890 con 0x7f73180ca140 2024-03-19T06:07:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.811+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c011c80 con 0x7f73180ca140 2024-03-19T06:07:37.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.811+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73181569c0 con 0x7f73180ca140 2024-03-19T06:07:37.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.811+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73181f40c0 con 0x7f73180ca140 2024-03-19T06:07:37.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.813+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7318069be0 con 0x7f73180ca140 2024-03-19T06:07:37.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.829+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbeb0056cd0 con 0x7fbec81541d0 2024-03-19T06:07:37.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.830+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fbeb0058c30 con 0x7fbec81541d0 2024-03-19T06:07:37.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.857+0000 7f45df400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45e00c9410 0x7f45e0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.859+0000 7f45df400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f45e00c9410 0x7f45e0159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47624/0 (socket says 172.21.15.17:47624) 2024-03-19T06:07:37.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.859+0000 7f45df400640 1 -- 172.21.15.17:0/2557505852 learned_addr learned my addr 172.21.15.17:0/2557505852 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.862+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f730c018020 con 0x7f73180ca140 2024-03-19T06:07:37.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.863+0000 7f7315600640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 0x7f72f806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.863+0000 7f45df400640 1 -- 172.21.15.17:0/2557505852 >> v1:172.21.15.153:6789/0 conn(0x7f45e015dc60 legacy=0x7f45e00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.863+0000 7f45df400640 1 -- 172.21.15.17:0/2557505852 >> v1:172.21.15.17:6789/0 conn(0x7f45e015b080 legacy=0x7f45e00ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:37.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.863+0000 7f45df400640 1 -- 172.21.15.17:0/2557505852 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e015a4c0 con 0x7f45e00c9410 2024-03-19T06:07:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.864+0000 7f731ca00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 0x7f72f806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.865+0000 7f731ca00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 0x7f72f806e0e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7304036000 tx=0x7f7304030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.868+0000 7f45df400640 1 --2- 172.21.15.17:0/2557505852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e0159c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc44e8fc6f2800eb server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.869+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f730c0576a0 con 0x7f73180ca140 2024-03-19T06:07:37.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.873+0000 7f45de000640 1 -- 172.21.15.17:0/2557505852 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0035020 con 0x7f45e00c9410 2024-03-19T06:07:37.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.873+0000 7f45de000640 1 -- 172.21.15.17:0/2557505852 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d0031870 con 0x7f45e00c9410 2024-03-19T06:07:37.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.873+0000 7f45de000640 1 -- 172.21.15.17:0/2557505852 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d0031c40 con 0x7f45e00c9410 2024-03-19T06:07:37.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 -- 172.21.15.17:0/2557505852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 msgr2=0x7f45e0159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2557505852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e0159c10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d002b910 comp rx=0 tx=0).stop 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 -- 172.21.15.17:0/2557505852 shutdown_connections 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2557505852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e0159c10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 -- 172.21.15.17:0/2557505852 >> 172.21.15.17:0/2557505852 conn(0x7f45e0072360 msgr2=0x7f45e0072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 -- 172.21.15.17:0/2557505852 shutdown_connections 2024-03-19T06:07:37.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.874+0000 7f45e4e00640 1 -- 172.21.15.17:0/2557505852 wait complete. 2024-03-19T06:07:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.877+0000 7f45e4e00640 1 Processor -- start 2024-03-19T06:07:37.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.877+0000 7f45e4e00640 1 -- start start 2024-03-19T06:07:37.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45e015b080 0x7f45e014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45e015dc60 0x7f45e01efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015d180 con 0x7f45e00c9410 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015aa80 con 0x7f45e015b080 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.879+0000 7f45e4e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015d460 con 0x7f45e015dc60 2024-03-19T06:07:37.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.880+0000 7f45df400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.880+0000 7f45df400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47658/0 (socket says 172.21.15.17:47658) 2024-03-19T06:07:37.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.880+0000 7f45df400640 1 -- 172.21.15.17:0/2205263226 learned_addr learned my addr 172.21.15.17:0/2205263226 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:37.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.887+0000 7f45df400640 1 -- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45e015dc60 msgr2=0x7f45e01efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.887+0000 7f45df400640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45e015dc60 0x7f45e01efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.887+0000 7f45df400640 1 -- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45e015b080 msgr2=0x7f45e014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.887+0000 7f45df400640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45e015b080 0x7f45e014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:37.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.887+0000 7f45df400640 1 -- 172.21.15.17:0/2205263226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0157eb0 con 0x7f45e00c9410 2024-03-19T06:07:37.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.891+0000 7f45df400640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.896+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d003ad60 con 0x7f45e00c9410 2024-03-19T06:07:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.897+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d00443f0 con 0x7f45e00c9410 2024-03-19T06:07:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.897+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00447e0 con 0x7f45e00c9410 2024-03-19T06:07:37.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.897+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00c7490 con 0x7f45e00c9410 2024-03-19T06:07:37.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.897+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e014ed70 con 0x7f45e00c9410 2024-03-19T06:07:37.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.898+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e004f050 con 0x7f45e00c9410 2024-03-19T06:07:37.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.902+0000 7efe55e00640 1 Processor -- start 2024-03-19T06:07:37.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.903+0000 7efe55e00640 1 -- start start 2024-03-19T06:07:37.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.905+0000 7efe55e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe50150dc0 0x7efe500c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.905+0000 7efe55e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe500c72d0 0x7efe5006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.905+0000 7efe55e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe50157650 con 0x7efe5015ae50 2024-03-19T06:07:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.905+0000 7efe55e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5015a120 con 0x7efe500c72d0 2024-03-19T06:07:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.905+0000 7efe55e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe50157930 con 0x7efe50150dc0 2024-03-19T06:07:37.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.927+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f45d004b060 con 0x7f45e00c9410 2024-03-19T06:07:37.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.929+0000 7f45d7400640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 0x7f45c006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.929+0000 7f45dea00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 0x7f45c006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.930+0000 7f45dea00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 0x7f45c006e110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45e00ca320 tx=0x7f45cc007990 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.977+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb41c037070 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.978+0000 7fb423400640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 0x7fb40c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.979+0000 7fb42a000640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 0x7fb40c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:37.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.979+0000 7fb42a000640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 0x7fb40c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0cff90 tx=0x7fb418009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.981+0000 7f9ac6800640 1 Processor -- start 2024-03-19T06:07:37.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.981+0000 7f9ac6800640 1 -- start start 2024-03-19T06:07:37.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.982+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb41c039e00 con 0x7fb42c0cb8d0 2024-03-19T06:07:37.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.983+0000 7f9ac6800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f9ac0153d70 0x7f9ac00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.983+0000 7f9ac6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:37.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.983+0000 7f9ac6800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac0154150 con 0x7f9ac015dd80 2024-03-19T06:07:37.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.983+0000 7f9ac6800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac00cbb50 con 0x7f9ac0153d70 2024-03-19T06:07:37.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:37.983+0000 7f9ac6800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015e1b0 con 0x7f9ac00ca4c0 2024-03-19T06:07:37.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.002+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb42c0c9fd0 con 0x7fb42c0cb8d0 2024-03-19T06:07:38.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.012+0000 7efe4f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe500c72d0 0x7efe5006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.014+0000 7efe4f400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efe500c72d0 0x7efe5006e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41584/0 (socket says 172.21.15.17:41584) 2024-03-19T06:07:38.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.014+0000 7efe4f400640 1 -- 172.21.15.17:0/895095588 learned_addr learned my addr 172.21.15.17:0/895095588 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.021+0000 7efe4f400640 1 -- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe50150dc0 msgr2=0x7efe500c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.021+0000 7efe4f400640 1 --2- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe50150dc0 0x7efe500c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.021+0000 7efe4f400640 1 -- 172.21.15.17:0/895095588 >> v1:172.21.15.17:6789/0 conn(0x7efe5015ae50 legacy=0x7efe50156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.021+0000 7efe4f400640 1 -- 172.21.15.17:0/895095588 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5015a370 con 0x7efe500c72d0 2024-03-19T06:07:38.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.024+0000 7efe4f400640 1 --2- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe500c72d0 0x7efe5006e720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe48009e50 tx=0x7efe4802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df63b6c89981006 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.031+0000 7efe4d600640 1 -- 172.21.15.17:0/895095588 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4802ca70 con 0x7efe500c72d0 2024-03-19T06:07:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.031+0000 7efe4d600640 1 -- 172.21.15.17:0/895095588 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4802cc10 con 0x7efe500c72d0 2024-03-19T06:07:38.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.031+0000 7efe4d600640 1 -- 172.21.15.17:0/895095588 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480343f0 con 0x7efe500c72d0 2024-03-19T06:07:38.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.032+0000 7efe55e00640 1 -- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe500c72d0 msgr2=0x7efe5006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.032+0000 7efe55e00640 1 --2- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe500c72d0 0x7efe5006e720 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe48009e50 tx=0x7efe4802bed0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 -- 172.21.15.17:0/895095588 shutdown_connections 2024-03-19T06:07:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 --2- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe500c72d0 0x7efe5006e720 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 --2- 172.21.15.17:0/895095588 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe50150dc0 0x7efe500c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 -- 172.21.15.17:0/895095588 >> 172.21.15.17:0/895095588 conn(0x7efe500c8910 msgr2=0x7efe500cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 -- 172.21.15.17:0/895095588 shutdown_connections 2024-03-19T06:07:38.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.033+0000 7efe55e00640 1 -- 172.21.15.17:0/895095588 wait complete. 2024-03-19T06:07:38.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.037+0000 7efe55e00640 1 Processor -- start 2024-03-19T06:07:38.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.038+0000 7efe55e00640 1 -- start start 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe500c72d0 0x7efe50154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50150dc0 0x7efe501463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500c4be0 con 0x7efe50150dc0 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5015a930 con 0x7efe5015ae50 2024-03-19T06:07:38.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.039+0000 7efe55e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe501511a0 con 0x7efe500c72d0 2024-03-19T06:07:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.040+0000 7efe4f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.041+0000 7efe4f400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41596/0 (socket says 172.21.15.17:41596) 2024-03-19T06:07:38.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.041+0000 7efe4f400640 1 -- 172.21.15.17:0/3537061583 learned_addr learned my addr 172.21.15.17:0/3537061583 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.047+0000 7efe4f400640 1 -- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe500c72d0 msgr2=0x7efe50154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.047+0000 7efe4f400640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe500c72d0 0x7efe50154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.047+0000 7efe4f400640 1 -- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50150dc0 msgr2=0x7efe501463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.047+0000 7efe4f400640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50150dc0 0x7efe501463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.047+0000 7efe4f400640 1 -- 172.21.15.17:0/3537061583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50157df0 con 0x7efe5015ae50 2024-03-19T06:07:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.051+0000 7efe4f400640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe48036040 tx=0x7efe48004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.061+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48043020 con 0x7efe5015ae50 2024-03-19T06:07:38.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.061+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4803e450 con 0x7efe5015ae50 2024-03-19T06:07:38.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.061+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4803e820 con 0x7efe5015ae50 2024-03-19T06:07:38.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.062+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe50154e70 con 0x7efe5015ae50 2024-03-19T06:07:38.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.062+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe50159790 con 0x7efe5015ae50 2024-03-19T06:07:38.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.063+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe50069be0 con 0x7efe5015ae50 2024-03-19T06:07:38.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.066+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbec80cb330 con 0x7fbec81541d0 2024-03-19T06:07:38.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-19T06:07:38.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-19T06:07:38.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.170+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f730c01f020 con 0x7f73180ca140 2024-03-19T06:07:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.177+0000 7f9abea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.178+0000 7f9abea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49786/0 (socket says 172.21.15.17:49786) 2024-03-19T06:07:38.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.178+0000 7f9abea00640 1 -- 172.21.15.17:0/4115291121 learned_addr learned my addr 172.21.15.17:0/4115291121 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.182+0000 7f9abea00640 1 -- 172.21.15.17:0/4115291121 >> v2:172.21.15.17:3300/0 conn(0x7f9ac0153d70 msgr2=0x7f9ac00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.182+0000 7f9abea00640 1 --2- 172.21.15.17:0/4115291121 >> v2:172.21.15.17:3300/0 conn(0x7f9ac0153d70 0x7f9ac00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.182+0000 7f9abea00640 1 -- 172.21.15.17:0/4115291121 >> v1:172.21.15.17:6789/0 conn(0x7f9ac015dd80 legacy=0x7f9ac006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.182+0000 7f9abea00640 1 -- 172.21.15.17:0/4115291121 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac015ac10 con 0x7f9ac00ca4c0 2024-03-19T06:07:38.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.195+0000 7f9abea00640 1 --2- 172.21.15.17:0/4115291121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00cd090 tx=0x7f9aac02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db6aa5daffcd04f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.264+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f45d0079430 con 0x7f45e00c9410 2024-03-19T06:07:38.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.265+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f45d003f070 con 0x7f45e00c9410 2024-03-19T06:07:38.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.284+0000 7f9abe000640 1 -- 172.21.15.17:0/4115291121 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac004230 con 0x7f9ac00ca4c0 2024-03-19T06:07:38.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.284+0000 7f9abe000640 1 -- 172.21.15.17:0/4115291121 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac0043d0 con 0x7f9ac00ca4c0 2024-03-19T06:07:38.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.284+0000 7f9abe000640 1 -- 172.21.15.17:0/4115291121 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac003810 con 0x7f9ac00ca4c0 2024-03-19T06:07:38.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 -- 172.21.15.17:0/4115291121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 msgr2=0x7f9ac015d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 --2- 172.21.15.17:0/4115291121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00cd090 tx=0x7f9aac02b960 comp rx=0 tx=0).stop 2024-03-19T06:07:38.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 -- 172.21.15.17:0/4115291121 shutdown_connections 2024-03-19T06:07:38.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 --2- 172.21.15.17:0/4115291121 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac00ca4c0 0x7f9ac015d840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 --2- 172.21.15.17:0/4115291121 >> v2:172.21.15.17:3300/0 conn(0x7f9ac0153d70 0x7f9ac00c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.285+0000 7f9ac6800640 1 -- 172.21.15.17:0/4115291121 >> 172.21.15.17:0/4115291121 conn(0x7f9ac0066e10 msgr2=0x7f9ac006bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.286+0000 7f9ac6800640 1 -- 172.21.15.17:0/4115291121 shutdown_connections 2024-03-19T06:07:38.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.286+0000 7f9ac6800640 1 -- 172.21.15.17:0/4115291121 wait complete. 2024-03-19T06:07:38.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.288+0000 7f9ac6800640 1 Processor -- start 2024-03-19T06:07:38.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.289+0000 7f9ac6800640 1 -- start start 2024-03-19T06:07:38.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00ca4c0 0x7f9ac01f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0153d70 0x7f9ac01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015a650 con 0x7f9ac0153d70 2024-03-19T06:07:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015a370 con 0x7f9ac00ca4c0 2024-03-19T06:07:38.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.290+0000 7f9ac6800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac015a930 con 0x7f9ac015dd80 2024-03-19T06:07:38.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.297+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.299+0000 7f9abfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:49810/0 (socket says 172.21.15.17:49810) 2024-03-19T06:07:38.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.299+0000 7f9abfe00640 1 -- 172.21.15.17:0/1764285380 learned_addr learned my addr 172.21.15.17:0/1764285380 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.302+0000 7f9abea00640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0153d70 0x7f9ac01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.307+0000 7f9abfe00640 1 -- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00ca4c0 msgr2=0x7f9ac01f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.307+0000 7f9abfe00640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00ca4c0 0x7f9ac01f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.307+0000 7f9abfe00640 1 -- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0153d70 msgr2=0x7f9ac01597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.307+0000 7f9abfe00640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0153d70 0x7f9ac01597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.307+0000 7f9abfe00640 1 -- 172.21.15.17:0/1764285380 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac01f4d00 con 0x7f9ac015dd80 2024-03-19T06:07:38.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.312+0000 7f9abfe00640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800b990 tx=0x7f9ab800be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.316+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8019070 con 0x7f9ac015dd80 2024-03-19T06:07:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.316+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800cba0 con 0x7f9ac015dd80 2024-03-19T06:07:38.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.316+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8014440 con 0x7f9ac015dd80 2024-03-19T06:07:38.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.317+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac01f4fe0 con 0x7f9ac015dd80 2024-03-19T06:07:38.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.317+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac01f7cf0 con 0x7f9ac015dd80 2024-03-19T06:07:38.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.317+0000 7fbebea00640 1 -- 172.21.15.17:0/2589318197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbeb005ccd0 con 0x7fbec81541d0 2024-03-19T06:07:38.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.319+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac00c50d0 con 0x7f9ac015dd80 2024-03-19T06:07:38.310 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:38.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 msgr2=0x7fbea406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 0x7fbea406e0e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009bd0 tx=0x7fbeb8009240 comp rx=0 tx=0).stop 2024-03-19T06:07:38.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 msgr2=0x7fbec814fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c430 tx=0x7fbeb000c8f0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 shutdown_connections 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fbec815d860 0x7fbec81f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbec81541d0 0x7fbec814fde0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbea406bc20 0x7fbea406e0e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.322+0000 7fbecd400640 1 --2- 172.21.15.17:0/2589318197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec80cb8d0 0x7fbec814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.323+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 >> 172.21.15.17:0/2589318197 conn(0x7fbec806baf0 msgr2=0x7fbec80cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.323+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 shutdown_connections 2024-03-19T06:07:38.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.323+0000 7fbecd400640 1 -- 172.21.15.17:0/2589318197 wait complete. 2024-03-19T06:07:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.334+0000 7efc99800640 1 Processor -- start 2024-03-19T06:07:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.335+0000 7efc99800640 1 -- start start 2024-03-19T06:07:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.336+0000 7efc99800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc94154130 0x7efc9415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.336+0000 7efc99800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efc9415d800 0x7efc94072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.336+0000 7efc99800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940cbd80 con 0x7efc940d0230 2024-03-19T06:07:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.336+0000 7efc99800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940cb330 con 0x7efc94154130 2024-03-19T06:07:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.336+0000 7efc99800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940cb8f0 con 0x7efc9415d800 2024-03-19T06:07:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.337+0000 7efc92a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc94154130 0x7efc9415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.337+0000 7efc92a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc94154130 0x7efc9415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47692/0 (socket says 172.21.15.17:47692) 2024-03-19T06:07:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.337+0000 7efc92a00640 1 -- 172.21.15.17:0/1800306740 learned_addr learned my addr 172.21.15.17:0/1800306740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.341+0000 7efc92a00640 1 -- 172.21.15.17:0/1800306740 >> v2:172.21.15.153:3300/0 conn(0x7efc9415d800 msgr2=0x7efc94072360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.341+0000 7efc92a00640 1 --2- 172.21.15.17:0/1800306740 >> v2:172.21.15.153:3300/0 conn(0x7efc9415d800 0x7efc94072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.341+0000 7efc92a00640 1 -- 172.21.15.17:0/1800306740 >> v1:172.21.15.153:6789/0 conn(0x7efc940d0230 legacy=0x7efc9406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.341+0000 7efc92a00640 1 -- 172.21.15.17:0/1800306740 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940cae90 con 0x7efc94154130 2024-03-19T06:07:38.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.345+0000 7efc92a00640 1 --2- 172.21.15.17:0/1800306740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9415d2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc940cbfe0 tx=0x7efc8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9043ca596426a9e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.345+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb42c0c4910 con 0x7fb42c0cb8d0 2024-03-19T06:07:38.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.0 2024-03-19T06:07:38.343 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.351+0000 7efc91600640 1 -- 172.21.15.17:0/1800306740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84035020 con 0x7efc94154130 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.351+0000 7efc91600640 1 -- 172.21.15.17:0/1800306740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84031870 con 0x7efc94154130 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.351+0000 7efc91600640 1 -- 172.21.15.17:0/1800306740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84031c40 con 0x7efc94154130 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 -- 172.21.15.17:0/1800306740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 msgr2=0x7efc9415d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 --2- 172.21.15.17:0/1800306740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9415d2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc940cbfe0 tx=0x7efc8402b910 comp rx=0 tx=0).stop 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 -- 172.21.15.17:0/1800306740 shutdown_connections 2024-03-19T06:07:38.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 --2- 172.21.15.17:0/1800306740 >> v2:172.21.15.153:3300/0 conn(0x7efc9415d800 0x7efc94072360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 --2- 172.21.15.17:0/1800306740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9415d2c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.352+0000 7efc99800640 1 -- 172.21.15.17:0/1800306740 >> 172.21.15.17:0/1800306740 conn(0x7efc94066c00 msgr2=0x7efc940cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.353+0000 7efc99800640 1 -- 172.21.15.17:0/1800306740 shutdown_connections 2024-03-19T06:07:38.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.353+0000 7efc99800640 1 -- 172.21.15.17:0/1800306740 wait complete. 2024-03-19T06:07:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.355+0000 7efc99800640 1 Processor -- start 2024-03-19T06:07:38.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.356+0000 7efc99800640 1 -- start start 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.356+0000 7efc99800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc940d0230 0x7efc941f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.357+0000 7efc99800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.357+0000 7efc99800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc9415d800 0x7efc9415c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.357+0000 7efc99800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940ca5e0 con 0x7efc94154130 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.357+0000 7efc99800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940cb580 con 0x7efc9415d800 2024-03-19T06:07:38.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.357+0000 7efc99800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940c9f80 con 0x7efc940d0230 2024-03-19T06:07:38.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.358+0000 7efc92000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.358+0000 7efc92000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47694/0 (socket says 172.21.15.17:47694) 2024-03-19T06:07:38.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.358+0000 7efc92000640 1 -- 172.21.15.17:0/34212368 learned_addr learned my addr 172.21.15.17:0/34212368 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.364+0000 7efc92000640 1 -- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc940d0230 msgr2=0x7efc941f7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.364+0000 7efc92000640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc940d0230 0x7efc941f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.364+0000 7efc92000640 1 -- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc9415d800 msgr2=0x7efc9415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.364+0000 7efc92000640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc9415d800 0x7efc9415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.364+0000 7efc92000640 1 -- 172.21.15.17:0/34212368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9414b0e0 con 0x7efc94154130 2024-03-19T06:07:38.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.368+0000 7efc92000640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efc8000b420 tx=0x7efc8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.373+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80005970 con 0x7efc94154130 2024-03-19T06:07:38.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.373+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc80005b10 con 0x7efc94154130 2024-03-19T06:07:38.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.373+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc80006020 con 0x7efc94154130 2024-03-19T06:07:38.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.374+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9414dcb0 con 0x7efc94154130 2024-03-19T06:07:38.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.374+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc941f4030 con 0x7efc94154130 2024-03-19T06:07:38.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.376+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc941f3e40 con 0x7efc94154130 2024-03-19T06:07:38.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.384+0000 7ff7b3000640 1 Processor -- start 2024-03-19T06:07:38.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.384+0000 7ff7b3000640 1 -- start start 2024-03-19T06:07:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.385+0000 7ff7b3000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff7ac15aa00 0x7ff7ac0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.385+0000 7ff7b3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac0c6720 0x7ff7ac070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.385+0000 7ff7b3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac1542b0 con 0x7ff7ac153ed0 2024-03-19T06:07:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.385+0000 7ff7b3000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac15e1d0 con 0x7ff7ac15aa00 2024-03-19T06:07:38.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.385+0000 7ff7b3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac15d5c0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.414+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efc80018020 con 0x7efc94154130 2024-03-19T06:07:38.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.415+0000 7efc8aa00640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 0x7efc7406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.415+0000 7efc92a00640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 0x7efc7406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.416+0000 7efc92a00640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 0x7efc7406e110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc84036000 tx=0x7efc84030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.447+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efe48046020 con 0x7efe5015ae50 2024-03-19T06:07:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.448+0000 7efe47400640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 0x7efe3006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.449+0000 7efe4ea00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 0x7efe3006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.450+0000 7efe4ea00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 0x7efe3006e0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe40009710 tx=0x7efe40006c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.460+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efe48079f00 con 0x7efe5015ae50 2024-03-19T06:07:38.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.475+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f73180cd590 con 0x7f73180ca140 2024-03-19T06:07:38.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.498+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7efe4804d030 con 0x7efe5015ae50 2024-03-19T06:07:38.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.500+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45e014a900 con 0x7f45e00c9410 2024-03-19T06:07:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.509+0000 7ff7b1000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac0c6720 0x7ff7ac070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.510+0000 7ff7b1000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7ac0c6720 0x7ff7ac070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41646/0 (socket says 172.21.15.17:41646) 2024-03-19T06:07:38.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.510+0000 7ff7b1000640 1 -- 172.21.15.17:0/674467162 learned_addr learned my addr 172.21.15.17:0/674467162 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.517+0000 7ff7b1000640 1 -- 172.21.15.17:0/674467162 >> v2:172.21.15.17:3300/0 conn(0x7ff7ac15aa00 msgr2=0x7ff7ac0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.517+0000 7ff7b1000640 1 --2- 172.21.15.17:0/674467162 >> v2:172.21.15.17:3300/0 conn(0x7ff7ac15aa00 0x7ff7ac0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.517+0000 7ff7b1000640 1 -- 172.21.15.17:0/674467162 >> v1:172.21.15.153:6789/0 conn(0x7ff7ac153ed0 legacy=0x7ff7ac06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:38.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.517+0000 7ff7b1000640 1 -- 172.21.15.17:0/674467162 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac15d8a0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.531+0000 7ff7b1000640 1 --2- 172.21.15.17:0/674467162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac070d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0732c0 tx=0x7ff7a402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=125c3a48807c46f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.549+0000 7ff7aaa00640 1 -- 172.21.15.17:0/674467162 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402cb20 con 0x7ff7ac0c6720 2024-03-19T06:07:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.549+0000 7ff7aaa00640 1 -- 172.21.15.17:0/674467162 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a402ccc0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.549+0000 7ff7aaa00640 1 -- 172.21.15.17:0/674467162 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4034610 con 0x7ff7ac0c6720 2024-03-19T06:07:38.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 -- 172.21.15.17:0/674467162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 msgr2=0x7ff7ac070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 --2- 172.21.15.17:0/674467162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac070d30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0732c0 tx=0x7ff7a402bf80 comp rx=0 tx=0).stop 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 -- 172.21.15.17:0/674467162 shutdown_connections 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 --2- 172.21.15.17:0/674467162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac070d30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 --2- 172.21.15.17:0/674467162 >> v2:172.21.15.17:3300/0 conn(0x7ff7ac15aa00 0x7ff7ac0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 -- 172.21.15.17:0/674467162 >> 172.21.15.17:0/674467162 conn(0x7ff7ac0c8910 msgr2=0x7ff7ac0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7fb423400640 1 -- 172.21.15.17:0/3898226432 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb42c0c4910 con 0x7fb42c0cb8d0 2024-03-19T06:07:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 -- 172.21.15.17:0/674467162 shutdown_connections 2024-03-19T06:07:38.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.550+0000 7ff7b3000640 1 -- 172.21.15.17:0/674467162 wait complete. 2024-03-19T06:07:38.542 INFO:teuthology.orchestra.run.smithi017.stdout:68719476758 2024-03-19T06:07:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7ff7b3000640 1 Processor -- start 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 msgr2=0x7fb40c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 0x7fb40c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0cff90 tx=0x7fb418009040 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 msgr2=0x7fb42c14f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009890 tx=0x7fb41c0046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 shutdown_connections 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb42c15d860 0x7fb42c14cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb42c1541d0 0x7fb42c0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb40c06bbd0 0x7fb40c06e090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 --2- 172.21.15.17:0/3898226432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb42c0cb8d0 0x7fb42c14f9f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 >> 172.21.15.17:0/3898226432 conn(0x7fb42c06baf0 msgr2=0x7fb42c073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7ff7b3000640 1 -- start start 2024-03-19T06:07:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 shutdown_connections 2024-03-19T06:07:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.553+0000 7fb431e00640 1 -- 172.21.15.17:0/3898226432 wait complete. 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7ac153ed0 0x7ff7ac1e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7ac15aa00 0x7ff7ac152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac06ee30 con 0x7ff7ac153ed0 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac15de60 con 0x7ff7ac0c6720 2024-03-19T06:07:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.554+0000 7ff7b3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac06efb0 con 0x7ff7ac15aa00 2024-03-19T06:07:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.559+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.560+0000 7ff7abe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41662/0 (socket says 172.21.15.17:41662) 2024-03-19T06:07:38.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.560+0000 7ff7abe00640 1 -- 172.21.15.17:0/272599466 learned_addr learned my addr 172.21.15.17:0/272599466 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:38.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476758 got 68719476758 for osd.5 2024-03-19T06:07:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.569+0000 7ff7abe00640 1 -- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7ac15aa00 msgr2=0x7ff7ac152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.569+0000 7ff7abe00640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7ac15aa00 0x7ff7ac152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.569+0000 7ff7abe00640 1 -- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7ac153ed0 msgr2=0x7ff7ac1e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.569+0000 7ff7abe00640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7ac153ed0 0x7ff7ac1e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.569+0000 7ff7abe00640 1 -- 172.21.15.17:0/272599466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac1549f0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.561 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:38.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.573+0000 7ff7abe00640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c410 tx=0x7ff79c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.581+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c017070 con 0x7ff7ac0c6720 2024-03-19T06:07:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.581+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c0035f0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.581+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac155a20 con 0x7ff7ac0c6720 2024-03-19T06:07:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.581+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0039e0 con 0x7ff7ac0c6720 2024-03-19T06:07:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.581+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac0c9f10 con 0x7ff7ac0c6720 2024-03-19T06:07:38.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.582+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac155850 con 0x7ff7ac0c6720 2024-03-19T06:07:38.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.675+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9ab801c070 con 0x7f9ac015dd80 2024-03-19T06:07:38.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.677+0000 7f9ab7400640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 0x7f9aa006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.678+0000 7f9abf400640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 0x7f9aa006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.679+0000 7f9abf400640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 0x7f9aa006e110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009710 tx=0x7f9ab0006c90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.679+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9ab80572e0 con 0x7f9ac015dd80 2024-03-19T06:07:38.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.708+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f9ac00c50d0 con 0x7f9ac015dd80 2024-03-19T06:07:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.726+0000 7f7315600640 1 -- 172.21.15.17:0/1955268403 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f731815ce60 con 0x7f73180ca140 2024-03-19T06:07:38.717 INFO:teuthology.orchestra.run.smithi017.stdout:68719476759 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 msgr2=0x7f72f806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 0x7f72f806e0e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7304036000 tx=0x7f7304030000 comp rx=0 tx=0).stop 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 msgr2=0x7f7318155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f730c00b440 tx=0x7f730c00b900 comp rx=0 tx=0).stop 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 shutdown_connections 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72f806bc20 0x7f72f806e0e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7318153d90 0x7f7318151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73180ca580 0x7f731815c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 --2- 172.21.15.17:0/1955268403 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f73180ca140 0x7f7318155f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 >> 172.21.15.17:0/1955268403 conn(0x7f7318066e10 msgr2=0x7f73180b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 shutdown_connections 2024-03-19T06:07:38.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.729+0000 7f731fe00640 1 -- 172.21.15.17:0/1955268403 wait complete. 2024-03-19T06:07:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.742+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe50070d70 con 0x7efe5015ae50 2024-03-19T06:07:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.742+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efc80057090 con 0x7efc94154130 2024-03-19T06:07:38.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.743+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7efc800596f0 con 0x7efc94154130 2024-03-19T06:07:38.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476759 got 68719476759 for osd.7 2024-03-19T06:07:38.737 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:38.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.877+0000 7f45d7400640 1 -- 172.21.15.17:0/2205263226 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45d007ba90 con 0x7f45e00c9410 2024-03-19T06:07:38.868 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 msgr2=0x7f45c006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 0x7f45c006e110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f45e00ca320 tx=0x7f45cc007990 comp rx=0 tx=0).stop 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 msgr2=0x7f45e01470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009870 tx=0x7f45d00046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 shutdown_connections 2024-03-19T06:07:38.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f45e015dc60 0x7f45e01efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f45c006bc50 0x7f45c006e110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45e015b080 0x7f45e014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 --2- 172.21.15.17:0/2205263226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45e00c9410 0x7f45e01470a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.880+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 >> 172.21.15.17:0/2205263226 conn(0x7f45e0072360 msgr2=0x7f45e00cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.881+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 shutdown_connections 2024-03-19T06:07:38.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.881+0000 7f45e4e00640 1 -- 172.21.15.17:0/2205263226 wait complete. 2024-03-19T06:07:38.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.2 2024-03-19T06:07:38.896 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:38.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.928+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7ff79c01a070 con 0x7ff7ac0c6720 2024-03-19T06:07:38.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.928+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9ac0069be0 con 0x7f9ac015dd80 2024-03-19T06:07:38.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.929+0000 7ff7a3e00640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 0x7ff78c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:38.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.930+0000 7ff7ab400640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 0x7ff78c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:38.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.931+0000 7ff7ab400640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 0x7ff78c06e0e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac06eb50 tx=0x7ff798006bf0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:38.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.934+0000 7f9ab7400640 1 -- 172.21.15.17:0/1764285380 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ab8023080 con 0x7f9ac015dd80 2024-03-19T06:07:38.925 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 msgr2=0x7f9aa006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 0x7f9aa006e110 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009710 tx=0x7f9ab0006c90 comp rx=0 tx=0).stop 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 msgr2=0x7f9ac014ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800b990 tx=0x7f9ab800be50 comp rx=0 tx=0).stop 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 shutdown_connections 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9ac015dd80 0x7f9ac014ba80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ac0153d70 0x7f9ac01597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f9aa006bc50 0x7f9aa006e110 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 --2- 172.21.15.17:0/1764285380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00ca4c0 0x7f9ac01f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.936+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 >> 172.21.15.17:0/1764285380 conn(0x7f9ac0066e10 msgr2=0x7f9ac00c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.937+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 shutdown_connections 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.937+0000 7f9ac6800640 1 -- 172.21.15.17:0/1764285380 wait complete. 2024-03-19T06:07:38.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.938+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff79c056820 con 0x7ff7ac0c6720 2024-03-19T06:07:38.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.6 2024-03-19T06:07:38.945 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:38.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.970+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efc94069be0 con 0x7efc94154130 2024-03-19T06:07:38.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.975+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7ff79c021020 con 0x7ff7ac0c6720 2024-03-19T06:07:38.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.981+0000 7efe47400640 1 -- 172.21.15.17:0/3537061583 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe4807c560 con 0x7efe5015ae50 2024-03-19T06:07:38.972 INFO:teuthology.orchestra.run.smithi017.stdout:68719476757 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 msgr2=0x7efe3006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 0x7efe3006e0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efe40009710 tx=0x7efe40006c90 comp rx=0 tx=0).stop 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 msgr2=0x7efe50144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efe48036040 tx=0x7efe48004a40 comp rx=0 tx=0).stop 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 shutdown_connections 2024-03-19T06:07:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efe3006bc20 0x7efe3006e0e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe5015ae50 0x7efe50144de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe50150dc0 0x7efe501463b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 --2- 172.21.15.17:0/3537061583 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efe500c72d0 0x7efe50154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.985+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 >> 172.21.15.17:0/3537061583 conn(0x7efe500c8910 msgr2=0x7efe500c9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.986+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 shutdown_connections 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.986+0000 7efe55e00640 1 -- 172.21.15.17:0/3537061583 wait complete. 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.986+0000 7efc8aa00640 1 -- 172.21.15.17:0/34212368 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efc80058ff0 con 0x7efc94154130 2024-03-19T06:07:38.977 INFO:teuthology.orchestra.run.smithi017.stdout:68719476757 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 msgr2=0x7efc7406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 0x7efc7406e110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc84036000 tx=0x7efc84030000 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 msgr2=0x7efc9414aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efc8000b420 tx=0x7efc8000b8e0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 shutdown_connections 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc7406bc50 0x7efc7406e110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc9415d800 0x7efc9415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc94154130 0x7efc9414aba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 --2- 172.21.15.17:0/34212368 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc940d0230 0x7efc941f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 >> 172.21.15.17:0/34212368 conn(0x7efc94066c00 msgr2=0x7efc9406bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 shutdown_connections 2024-03-19T06:07:38.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:38.989+0000 7efc99800640 1 -- 172.21.15.17:0/34212368 wait complete. 2024-03-19T06:07:38.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.4 2024-03-19T06:07:38.997 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:39.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.3 2024-03-19T06:07:39.002 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:39.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.194+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff7ac0c30c0 con 0x7ff7ac0c6720 2024-03-19T06:07:39.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.201+0000 7ff7a3e00640 1 -- 172.21.15.17:0/272599466 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7ac0c30c0 con 0x7ff7ac0c6720 2024-03-19T06:07:39.192 INFO:teuthology.orchestra.run.smithi017.stdout:64424509461 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 msgr2=0x7ff78c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 0x7ff78c06e0e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac06eb50 tx=0x7ff798006bf0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 msgr2=0x7ff7ac156500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff79c00c410 tx=0x7ff79c00c8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 shutdown_connections 2024-03-19T06:07:39.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7ff7ac15aa00 0x7ff7ac152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff7ac153ed0 0x7ff7ac1e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7ff78c06bc20 0x7ff78c06e0e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 --2- 172.21.15.17:0/272599466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7ac0c6720 0x7ff7ac156500 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 >> 172.21.15.17:0/272599466 conn(0x7ff7ac0c8910 msgr2=0x7ff7ac0c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.204+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 shutdown_connections 2024-03-19T06:07:39.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.205+0000 7ff7b3000640 1 -- 172.21.15.17:0/272599466 wait complete. 2024-03-19T06:07:39.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.1 2024-03-19T06:07:39.212 DEBUG:teuthology.parallel:result is None 2024-03-19T06:07:39.213 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-19T06:07:39.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:07:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.439+0000 7f46cfe00640 1 Processor -- start 2024-03-19T06:07:39.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.439+0000 7f46cfe00640 1 -- start start 2024-03-19T06:07:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cfe00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46d0159c10 0x7f46d015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cfe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f46d015dc60 0x7f46d00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cfe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d015a200 con 0x7f46d00c9410 2024-03-19T06:07:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cfe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d015e0d0 con 0x7f46d015dc60 2024-03-19T06:07:39.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cfe00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d00caac0 con 0x7f46d0159c10 2024-03-19T06:07:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cea00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f46d00c9410 0x7f46d00ca3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:60446/0 (socket says 172.21.15.17:60446) 2024-03-19T06:07:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.441+0000 7f46cea00640 1 -- 172.21.15.17:0/3761604298 learned_addr learned my addr 172.21.15.17:0/3761604298 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:39.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.442+0000 7f46ce000640 1 --2- 172.21.15.17:0/3761604298 >> v2:172.21.15.153:3300/0 conn(0x7f46d0159c10 0x7f46d015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.444+0000 7f46cf400640 1 --2- 172.21.15.17:0/3761604298 >> v2:172.21.15.17:3300/0 conn(0x7f46d015dc60 0x7f46d00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.445+0000 7f46cd600640 1 -- 172.21.15.17:0/3761604298 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887225744 0 0) 0x7f46d015a200 con 0x7f46d00c9410 2024-03-19T06:07:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.445+0000 7f46cd600640 1 -- 172.21.15.17:0/3761604298 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46b4003520 con 0x7f46d00c9410 2024-03-19T06:07:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.449+0000 7f46ce000640 1 -- 172.21.15.17:0/3761604298 >> v2:172.21.15.17:3300/0 conn(0x7f46d015dc60 msgr2=0x7f46d00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.449+0000 7f46ce000640 1 --2- 172.21.15.17:0/3761604298 >> v2:172.21.15.17:3300/0 conn(0x7f46d015dc60 0x7f46d00caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.449+0000 7f46ce000640 1 -- 172.21.15.17:0/3761604298 >> v1:172.21.15.17:6789/0 conn(0x7f46d00c9410 legacy=0x7f46d00ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.449+0000 7f46ce000640 1 -- 172.21.15.17:0/3761604298 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d015a4c0 con 0x7f46d0159c10 2024-03-19T06:07:39.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.454+0000 7f46ce000640 1 --2- 172.21.15.17:0/3761604298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d0159c10 0x7f46d015b080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46d0154550 tx=0x7f46bc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ad13fee346ab40 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.467+0000 7f46cd600640 1 -- 172.21.15.17:0/3761604298 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc035020 con 0x7f46d0159c10 2024-03-19T06:07:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.467+0000 7f46cd600640 1 -- 172.21.15.17:0/3761604298 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc031830 con 0x7f46d0159c10 2024-03-19T06:07:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.467+0000 7f46cd600640 1 -- 172.21.15.17:0/3761604298 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc031c00 con 0x7f46d0159c10 2024-03-19T06:07:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 -- 172.21.15.17:0/3761604298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d0159c10 msgr2=0x7f46d015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3761604298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d0159c10 0x7f46d015b080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46d0154550 tx=0x7f46bc02b8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 -- 172.21.15.17:0/3761604298 shutdown_connections 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3761604298 >> v2:172.21.15.17:3300/0 conn(0x7f46d015dc60 0x7f46d00caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3761604298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d0159c10 0x7f46d015b080 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 -- 172.21.15.17:0/3761604298 >> 172.21.15.17:0/3761604298 conn(0x7f46d0072360 msgr2=0x7f46d0072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 -- 172.21.15.17:0/3761604298 shutdown_connections 2024-03-19T06:07:39.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.468+0000 7f46cfe00640 1 -- 172.21.15.17:0/3761604298 wait complete. 2024-03-19T06:07:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.471+0000 7f46cfe00640 1 Processor -- start 2024-03-19T06:07:39.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.471+0000 7f46cfe00640 1 -- start start 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d00c9410 0x7f46d00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46d015dc60 0x7f46d01f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015d180 con 0x7f46d0159c10 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015aa80 con 0x7f46d00c9410 2024-03-19T06:07:39.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.472+0000 7f46cfe00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d015d460 con 0x7f46d015dc60 2024-03-19T06:07:39.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.473+0000 7f46ce000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.473+0000 7f46ce000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47730/0 (socket says 172.21.15.17:47730) 2024-03-19T06:07:39.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.473+0000 7f46ce000640 1 -- 172.21.15.17:0/3303024185 learned_addr learned my addr 172.21.15.17:0/3303024185 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:39.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.474+0000 7f46cea00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d00c9410 0x7f46d00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.474+0000 7f46cf400640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46d015dc60 0x7f46d01f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.477+0000 7f46ce000640 1 -- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46d015dc60 msgr2=0x7f46d01f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.477+0000 7f46ce000640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46d015dc60 0x7f46d01f2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.477+0000 7f46ce000640 1 -- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d00c9410 msgr2=0x7f46d00cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.477+0000 7f46ce000640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d00c9410 0x7f46d00cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:39.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.478+0000 7f46ce000640 1 -- 172.21.15.17:0/3303024185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d01e3030 con 0x7f46d0159c10 2024-03-19T06:07:39.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.481+0000 7f46ce000640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009890 tx=0x7f46bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.485+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc035040 con 0x7f46d0159c10 2024-03-19T06:07:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.485+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc03b920 con 0x7f46d0159c10 2024-03-19T06:07:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.485+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc03bd10 con 0x7f46d0159c10 2024-03-19T06:07:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.485+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d0154950 con 0x7f46d0159c10 2024-03-19T06:07:39.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.486+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d0157020 con 0x7f46d0159c10 2024-03-19T06:07:39.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.487+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d004f050 con 0x7f46d0159c10 2024-03-19T06:07:39.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.803+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f46bc038020 con 0x7f46d0159c10 2024-03-19T06:07:39.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.805+0000 7f46c6a00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 0x7f46b006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:39.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.806+0000 7f46cea00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 0x7f46b006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:39.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.807+0000 7f46cea00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 0x7f46b006e0e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46c0005880 tx=0x7f46c0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:39.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.849+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f46bc0317b0 con 0x7f46d0159c10 2024-03-19T06:07:39.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:39.850+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f46bc07b5f0 con 0x7f46d0159c10 2024-03-19T06:07:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.077+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46d015b350 con 0x7f46b006bc20 2024-03-19T06:07:40.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.102+0000 7f46c6a00640 1 -- 172.21.15.17:0/3303024185 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332614 (secure 0 0 0) 0x7f46d015b350 con 0x7f46b006bc20 2024-03-19T06:07:40.095 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:40.100 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 msgr2=0x7f46b006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 0x7f46b006e0e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46c0005880 tx=0x7f46c0009040 comp rx=0 tx=0).stop 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 msgr2=0x7f46d01f2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009890 tx=0x7f46bc0046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 shutdown_connections 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f46d015dc60 0x7f46d01f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46d0159c10 0x7f46d01f2ab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f46b006bc20 0x7f46b006e0e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 --2- 172.21.15.17:0/3303024185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46d00c9410 0x7f46d00cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.110+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 >> 172.21.15.17:0/3303024185 conn(0x7f46d0072360 msgr2=0x7f46d015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.111+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 shutdown_connections 2024-03-19T06:07:40.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.111+0000 7f46cfe00640 1 -- 172.21.15.17:0/3303024185 wait complete. 2024-03-19T06:07:40.123 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-03-19T06:07:39.322944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599226,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":328,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236792,"kb_used_data":4024,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737928,"statfs":{"total":773094113280,"available":772851638272,"internally_reserved":0,"allocated":4120576,"data_stored":2331244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3456,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004525"},"pg_stats":[{"pgid":"2.1f","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.404041+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:07:34.404041+0000","last_peered":"2024-03-19T06:07:34.404041+0000","last_clean":"2024-03-19T06:07:34.404041+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:07:34.404041+0000","last_undegraded":"2024-03-19T06:07:34.404041+0000","last_fullsized":"2024-03-19T06:07:34.404041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996193+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:07:01.996193+0000","last_peered":"2024-03-19T06:07:01.996193+0000","last_clean":"2024-03-19T06:07:01.996193+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:07:01.996193+0000","last_undegraded":"2024-03-19T06:07:01.996193+0000","last_fullsized":"2024-03-19T06:07:01.996193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992725+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:07:01.992725+0000","last_peered":"2024-03-19T06:07:01.992725+0000","last_clean":"2024-03-19T06:07:01.992725+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:07:01.992725+0000","last_undegraded":"2024-03-19T06:07:01.992725+0000","last_fullsized":"2024-03-19T06:07:01.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996674+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:07:01.996674+0000","last_peered":"2024-03-19T06:07:01.996674+0000","last_clean":"2024-03-19T06:07:01.996674+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:07:01.996674+0000","last_undegraded":"2024-03-19T06:07:01.996674+0000","last_fullsized":"2024-03-19T06:07:01.996674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043882+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:07:02.043882+0000","last_peered":"2024-03-19T06:07:02.043882+0000","last_clean":"2024-03-19T06:07:02.043882+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:07:02.043882+0000","last_undegraded":"2024-03-19T06:07:02.043882+0000","last_fullsized":"2024-03-19T06:07:02.043882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999673+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:07:01.999673+0000","last_peered":"2024-03-19T06:07:01.999673+0000","last_clean":"2024-03-19T06:07:01.999673+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:07:01.999673+0000","last_undegraded":"2024-03-19T06:07:01.999673+0000","last_fullsized":"2024-03-19T06:07:01.999673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.361948+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:07:34.361948+0000","last_peered":"2024-03-19T06:07:34.361948+0000","last_clean":"2024-03-19T06:07:34.361948+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:07:34.361948+0000","last_undegraded":"2024-03-19T06:07:34.361948+0000","last_fullsized":"2024-03-19T06:07:34.361948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247982+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:07:02.247982+0000","last_peered":"2024-03-19T06:07:02.247982+0000","last_clean":"2024-03-19T06:07:02.247982+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:07:02.247982+0000","last_undegraded":"2024-03-19T06:07:02.247982+0000","last_fullsized":"2024-03-19T06:07:02.247982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.159056+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:07:02.159056+0000","last_peered":"2024-03-19T06:07:02.159056+0000","last_clean":"2024-03-19T06:07:02.159056+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:07:02.159056+0000","last_undegraded":"2024-03-19T06:07:02.159056+0000","last_fullsized":"2024-03-19T06:07:02.159056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241176+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:07:02.241176+0000","last_peered":"2024-03-19T06:07:02.241176+0000","last_clean":"2024-03-19T06:07:02.241176+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:07:02.241176+0000","last_undegraded":"2024-03-19T06:07:02.241176+0000","last_fullsized":"2024-03-19T06:07:02.241176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247222+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:07:02.247222+0000","last_peered":"2024-03-19T06:07:02.247222+0000","last_clean":"2024-03-19T06:07:02.247222+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:07:02.247222+0000","last_undegraded":"2024-03-19T06:07:02.247222+0000","last_fullsized":"2024-03-19T06:07:02.247222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000220+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:07:02.000220+0000","last_peered":"2024-03-19T06:07:02.000220+0000","last_clean":"2024-03-19T06:07:02.000220+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:07:02.000220+0000","last_undegraded":"2024-03-19T06:07:02.000220+0000","last_fullsized":"2024-03-19T06:07:02.000220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154988+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:07:02.154988+0000","last_peered":"2024-03-19T06:07:02.154988+0000","last_clean":"2024-03-19T06:07:02.154988+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:07:02.154988+0000","last_undegraded":"2024-03-19T06:07:02.154988+0000","last_fullsized":"2024-03-19T06:07:02.154988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.566454+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:07:24.566454+0000","last_peered":"2024-03-19T06:07:24.566454+0000","last_clean":"2024-03-19T06:07:24.566454+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:07:24.566454+0000","last_undegraded":"2024-03-19T06:07:24.566454+0000","last_fullsized":"2024-03-19T06:07:24.566454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000701+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:07:02.000701+0000","last_peered":"2024-03-19T06:07:02.000701+0000","last_clean":"2024-03-19T06:07:02.000701+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:07:02.000701+0000","last_undegraded":"2024-03-19T06:07:02.000701+0000","last_fullsized":"2024-03-19T06:07:02.000701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.994372+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:07:01.994372+0000","last_peered":"2024-03-19T06:07:01.994372+0000","last_clean":"2024-03-19T06:07:01.994372+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:07:01.994372+0000","last_undegraded":"2024-03-19T06:07:01.994372+0000","last_fullsized":"2024-03-19T06:07:01.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.088539+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:07:31.088539+0000","last_peered":"2024-03-19T06:07:31.088539+0000","last_clean":"2024-03-19T06:07:31.088539+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:07:31.088539+0000","last_undegraded":"2024-03-19T06:07:31.088539+0000","last_fullsized":"2024-03-19T06:07:31.088539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001560+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:07:02.001560+0000","last_peered":"2024-03-19T06:07:02.001560+0000","last_clean":"2024-03-19T06:07:02.001560+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:07:02.001560+0000","last_undegraded":"2024-03-19T06:07:02.001560+0000","last_fullsized":"2024-03-19T06:07:02.001560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993604+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:07:01.993604+0000","last_peered":"2024-03-19T06:07:01.993604+0000","last_clean":"2024-03-19T06:07:01.993604+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:07:01.993604+0000","last_undegraded":"2024-03-19T06:07:01.993604+0000","last_fullsized":"2024-03-19T06:07:01.993604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.358159+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:07:34.358159+0000","last_peered":"2024-03-19T06:07:34.358159+0000","last_clean":"2024-03-19T06:07:34.358159+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:07:34.358159+0000","last_undegraded":"2024-03-19T06:07:34.358159+0000","last_fullsized":"2024-03-19T06:07:34.358159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004757+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:07:02.004757+0000","last_peered":"2024-03-19T06:07:02.004757+0000","last_clean":"2024-03-19T06:07:02.004757+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:07:02.004757+0000","last_undegraded":"2024-03-19T06:07:02.004757+0000","last_fullsized":"2024-03-19T06:07:02.004757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000136+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:07:02.000136+0000","last_peered":"2024-03-19T06:07:02.000136+0000","last_clean":"2024-03-19T06:07:02.000136+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:07:02.000136+0000","last_undegraded":"2024-03-19T06:07:02.000136+0000","last_fullsized":"2024-03-19T06:07:02.000136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.567976+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:07:24.567976+0000","last_peered":"2024-03-19T06:07:24.567976+0000","last_clean":"2024-03-19T06:07:24.567976+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:07:24.567976+0000","last_undegraded":"2024-03-19T06:07:24.567976+0000","last_fullsized":"2024-03-19T06:07:24.567976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001003+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:07:02.001003+0000","last_peered":"2024-03-19T06:07:02.001003+0000","last_clean":"2024-03-19T06:07:02.001003+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:07:02.001003+0000","last_undegraded":"2024-03-19T06:07:02.001003+0000","last_fullsized":"2024-03-19T06:07:02.001003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043713+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:07:02.043713+0000","last_peered":"2024-03-19T06:07:02.043713+0000","last_clean":"2024-03-19T06:07:02.043713+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:07:02.043713+0000","last_undegraded":"2024-03-19T06:07:02.043713+0000","last_fullsized":"2024-03-19T06:07:02.043713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.551709+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:07:24.551709+0000","last_peered":"2024-03-19T06:07:24.551709+0000","last_clean":"2024-03-19T06:07:24.551709+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:07:24.551709+0000","last_undegraded":"2024-03-19T06:07:24.551709+0000","last_fullsized":"2024-03-19T06:07:24.551709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000323+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:07:02.000323+0000","last_peered":"2024-03-19T06:07:02.000323+0000","last_clean":"2024-03-19T06:07:02.000323+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:07:02.000323+0000","last_undegraded":"2024-03-19T06:07:02.000323+0000","last_fullsized":"2024-03-19T06:07:02.000323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997387+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:07:01.997387+0000","last_peered":"2024-03-19T06:07:01.997387+0000","last_clean":"2024-03-19T06:07:01.997387+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:07:01.997387+0000","last_undegraded":"2024-03-19T06:07:01.997387+0000","last_fullsized":"2024-03-19T06:07:01.997387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.361827+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:07:34.361827+0000","last_peered":"2024-03-19T06:07:34.361827+0000","last_clean":"2024-03-19T06:07:34.361827+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:07:34.361827+0000","last_undegraded":"2024-03-19T06:07:34.361827+0000","last_fullsized":"2024-03-19T06:07:34.361827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246594+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:07:02.246594+0000","last_peered":"2024-03-19T06:07:02.246594+0000","last_clean":"2024-03-19T06:07:02.246594+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:07:02.246594+0000","last_undegraded":"2024-03-19T06:07:02.246594+0000","last_fullsized":"2024-03-19T06:07:02.246594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004937+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:07:02.004937+0000","last_peered":"2024-03-19T06:07:02.004937+0000","last_clean":"2024-03-19T06:07:02.004937+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:07:02.004937+0000","last_undegraded":"2024-03-19T06:07:02.004937+0000","last_fullsized":"2024-03-19T06:07:02.004937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.360551+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:07:34.360551+0000","last_peered":"2024-03-19T06:07:34.360551+0000","last_clean":"2024-03-19T06:07:34.360551+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:07:34.360551+0000","last_undegraded":"2024-03-19T06:07:34.360551+0000","last_fullsized":"2024-03-19T06:07:34.360551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042542+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:07:02.042542+0000","last_peered":"2024-03-19T06:07:02.042542+0000","last_clean":"2024-03-19T06:07:02.042542+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:07:02.042542+0000","last_undegraded":"2024-03-19T06:07:02.042542+0000","last_fullsized":"2024-03-19T06:07:02.042542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247206+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:07:02.247206+0000","last_peered":"2024-03-19T06:07:02.247206+0000","last_clean":"2024-03-19T06:07:02.247206+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:07:02.247206+0000","last_undegraded":"2024-03-19T06:07:02.247206+0000","last_fullsized":"2024-03-19T06:07:02.247206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005407+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:07:02.005407+0000","last_peered":"2024-03-19T06:07:02.005407+0000","last_clean":"2024-03-19T06:07:02.005407+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:07:02.005407+0000","last_undegraded":"2024-03-19T06:07:02.005407+0000","last_fullsized":"2024-03-19T06:07:02.005407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002045+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:07:02.002045+0000","last_peered":"2024-03-19T06:07:02.002045+0000","last_clean":"2024-03-19T06:07:02.002045+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:07:02.002045+0000","last_undegraded":"2024-03-19T06:07:02.002045+0000","last_fullsized":"2024-03-19T06:07:02.002045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002384+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:07:02.002384+0000","last_peered":"2024-03-19T06:07:02.002384+0000","last_clean":"2024-03-19T06:07:02.002384+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:07:02.002384+0000","last_undegraded":"2024-03-19T06:07:02.002384+0000","last_fullsized":"2024-03-19T06:07:02.002384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246801+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:07:02.246801+0000","last_peered":"2024-03-19T06:07:02.246801+0000","last_clean":"2024-03-19T06:07:02.246801+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:07:02.246801+0000","last_undegraded":"2024-03-19T06:07:02.246801+0000","last_fullsized":"2024-03-19T06:07:02.246801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004767+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:07:02.004767+0000","last_peered":"2024-03-19T06:07:02.004767+0000","last_clean":"2024-03-19T06:07:02.004767+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:07:02.004767+0000","last_undegraded":"2024-03-19T06:07:02.004767+0000","last_fullsized":"2024-03-19T06:07:02.004767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002256+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:07:02.002256+0000","last_peered":"2024-03-19T06:07:02.002256+0000","last_clean":"2024-03-19T06:07:02.002256+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:07:02.002256+0000","last_undegraded":"2024-03-19T06:07:02.002256+0000","last_fullsized":"2024-03-19T06:07:02.002256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.679888+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:07:31.679888+0000","last_peered":"2024-03-19T06:07:31.679888+0000","last_clean":"2024-03-19T06:07:31.679888+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:07:31.679888+0000","last_undegraded":"2024-03-19T06:07:31.679888+0000","last_fullsized":"2024-03-19T06:07:31.679888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004938+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:07:02.004938+0000","last_peered":"2024-03-19T06:07:02.004938+0000","last_clean":"2024-03-19T06:07:02.004938+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:07:02.004938+0000","last_undegraded":"2024-03-19T06:07:02.004938+0000","last_fullsized":"2024-03-19T06:07:02.004938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042134+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:07:02.042134+0000","last_peered":"2024-03-19T06:07:02.042134+0000","last_clean":"2024-03-19T06:07:02.042134+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:07:02.042134+0000","last_undegraded":"2024-03-19T06:07:02.042134+0000","last_fullsized":"2024-03-19T06:07:02.042134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.652118+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:07:31.652118+0000","last_peered":"2024-03-19T06:07:31.652118+0000","last_clean":"2024-03-19T06:07:31.652118+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:07:31.652118+0000","last_undegraded":"2024-03-19T06:07:31.652118+0000","last_fullsized":"2024-03-19T06:07:31.652118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043281+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:07:02.043281+0000","last_peered":"2024-03-19T06:07:02.043281+0000","last_clean":"2024-03-19T06:07:02.043281+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:07:02.043281+0000","last_undegraded":"2024-03-19T06:07:02.043281+0000","last_fullsized":"2024-03-19T06:07:02.043281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993253+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:07:01.993253+0000","last_peered":"2024-03-19T06:07:01.993253+0000","last_clean":"2024-03-19T06:07:01.993253+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:07:01.993253+0000","last_undegraded":"2024-03-19T06:07:01.993253+0000","last_fullsized":"2024-03-19T06:07:01.993253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.189508+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:07:34.189508+0000","last_peered":"2024-03-19T06:07:34.189508+0000","last_clean":"2024-03-19T06:07:34.189508+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:07:34.189508+0000","last_undegraded":"2024-03-19T06:07:34.189508+0000","last_fullsized":"2024-03-19T06:07:34.189508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240669+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:07:02.240669+0000","last_peered":"2024-03-19T06:07:02.240669+0000","last_clean":"2024-03-19T06:07:02.240669+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:07:02.240669+0000","last_undegraded":"2024-03-19T06:07:02.240669+0000","last_fullsized":"2024-03-19T06:07:02.240669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155726+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:07:02.155726+0000","last_peered":"2024-03-19T06:07:02.155726+0000","last_clean":"2024-03-19T06:07:02.155726+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:07:02.155726+0000","last_undegraded":"2024-03-19T06:07:02.155726+0000","last_fullsized":"2024-03-19T06:07:02.155726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241852+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:07:02.241852+0000","last_peered":"2024-03-19T06:07:02.241852+0000","last_clean":"2024-03-19T06:07:02.241852+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:07:02.241852+0000","last_undegraded":"2024-03-19T06:07:02.241852+0000","last_fullsized":"2024-03-19T06:07:02.241852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.189348+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:07:34.189348+0000","last_peered":"2024-03-19T06:07:34.189348+0000","last_clean":"2024-03-19T06:07:34.189348+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:07:34.189348+0000","last_undegraded":"2024-03-19T06:07:34.189348+0000","last_fullsized":"2024-03-19T06:07:34.189348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154712+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:07:02.154712+0000","last_peered":"2024-03-19T06:07:02.154712+0000","last_clean":"2024-03-19T06:07:02.154712+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:07:02.154712+0000","last_undegraded":"2024-03-19T06:07:02.154712+0000","last_fullsized":"2024-03-19T06:07:02.154712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.248178+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:07:02.248178+0000","last_peered":"2024-03-19T06:07:02.248178+0000","last_clean":"2024-03-19T06:07:02.248178+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:07:02.248178+0000","last_undegraded":"2024-03-19T06:07:02.248178+0000","last_fullsized":"2024-03-19T06:07:02.248178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005304+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:07:02.005304+0000","last_peered":"2024-03-19T06:07:02.005304+0000","last_clean":"2024-03-19T06:07:02.005304+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:07:02.005304+0000","last_undegraded":"2024-03-19T06:07:02.005304+0000","last_fullsized":"2024-03-19T06:07:02.005304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043106+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:07:02.043106+0000","last_peered":"2024-03-19T06:07:02.043106+0000","last_clean":"2024-03-19T06:07:02.043106+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:07:02.043106+0000","last_undegraded":"2024-03-19T06:07:02.043106+0000","last_fullsized":"2024-03-19T06:07:02.043106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242959+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:07:02.242959+0000","last_peered":"2024-03-19T06:07:02.242959+0000","last_clean":"2024-03-19T06:07:02.242959+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:07:02.242959+0000","last_undegraded":"2024-03-19T06:07:02.242959+0000","last_fullsized":"2024-03-19T06:07:02.242959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000486+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:07:02.000486+0000","last_peered":"2024-03-19T06:07:02.000486+0000","last_clean":"2024-03-19T06:07:02.000486+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:07:02.000486+0000","last_undegraded":"2024-03-19T06:07:02.000486+0000","last_fullsized":"2024-03-19T06:07:02.000486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244381+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:07:02.244381+0000","last_peered":"2024-03-19T06:07:02.244381+0000","last_clean":"2024-03-19T06:07:02.244381+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:07:02.244381+0000","last_undegraded":"2024-03-19T06:07:02.244381+0000","last_fullsized":"2024-03-19T06:07:02.244381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242409+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:07:02.242409+0000","last_peered":"2024-03-19T06:07:02.242409+0000","last_clean":"2024-03-19T06:07:02.242409+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:07:02.242409+0000","last_undegraded":"2024-03-19T06:07:02.242409+0000","last_fullsized":"2024-03-19T06:07:02.242409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001979+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:07:02.001979+0000","last_peered":"2024-03-19T06:07:02.001979+0000","last_clean":"2024-03-19T06:07:02.001979+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:07:02.001979+0000","last_undegraded":"2024-03-19T06:07:02.001979+0000","last_fullsized":"2024-03-19T06:07:02.001979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999778+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:07:01.999778+0000","last_peered":"2024-03-19T06:07:01.999778+0000","last_clean":"2024-03-19T06:07:01.999778+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:07:01.999778+0000","last_undegraded":"2024-03-19T06:07:01.999778+0000","last_fullsized":"2024-03-19T06:07:01.999778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240955+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:07:02.240955+0000","last_peered":"2024-03-19T06:07:02.240955+0000","last_clean":"2024-03-19T06:07:02.240955+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:07:02.240955+0000","last_undegraded":"2024-03-19T06:07:02.240955+0000","last_fullsized":"2024-03-19T06:07:02.240955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.678216+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:07:31.678216+0000","last_peered":"2024-03-19T06:07:31.678216+0000","last_clean":"2024-03-19T06:07:31.678216+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:07:31.678216+0000","last_undegraded":"2024-03-19T06:07:31.678216+0000","last_fullsized":"2024-03-19T06:07:31.678216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043013+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:07:02.043013+0000","last_peered":"2024-03-19T06:07:02.043013+0000","last_clean":"2024-03-19T06:07:02.043013+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:07:02.043013+0000","last_undegraded":"2024-03-19T06:07:02.043013+0000","last_fullsized":"2024-03-19T06:07:02.043013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154227+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:07:02.154227+0000","last_peered":"2024-03-19T06:07:02.154227+0000","last_clean":"2024-03-19T06:07:02.154227+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:07:02.154227+0000","last_undegraded":"2024-03-19T06:07:02.154227+0000","last_fullsized":"2024-03-19T06:07:02.154227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.370841+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:07:34.370841+0000","last_peered":"2024-03-19T06:07:34.370841+0000","last_clean":"2024-03-19T06:07:34.370841+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:07:34.370841+0000","last_undegraded":"2024-03-19T06:07:34.370841+0000","last_fullsized":"2024-03-19T06:07:34.370841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997053+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:07:01.997053+0000","last_peered":"2024-03-19T06:07:01.997053+0000","last_clean":"2024-03-19T06:07:01.997053+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:07:01.997053+0000","last_undegraded":"2024-03-19T06:07:01.997053+0000","last_fullsized":"2024-03-19T06:07:01.997053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242714+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:07:02.242714+0000","last_peered":"2024-03-19T06:07:02.242714+0000","last_clean":"2024-03-19T06:07:02.242714+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:07:02.242714+0000","last_undegraded":"2024-03-19T06:07:02.242714+0000","last_fullsized":"2024-03-19T06:07:02.242714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.563715+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:07:24.563715+0000","last_peered":"2024-03-19T06:07:24.563715+0000","last_clean":"2024-03-19T06:07:24.563715+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:07:24.563715+0000","last_undegraded":"2024-03-19T06:07:24.563715+0000","last_fullsized":"2024-03-19T06:07:24.563715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.251618+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:07:02.251618+0000","last_peered":"2024-03-19T06:07:02.251618+0000","last_clean":"2024-03-19T06:07:02.251618+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:07:02.251618+0000","last_undegraded":"2024-03-19T06:07:02.251618+0000","last_fullsized":"2024-03-19T06:07:02.251618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042759+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:07:02.042759+0000","last_peered":"2024-03-19T06:07:02.042759+0000","last_clean":"2024-03-19T06:07:02.042759+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:07:02.042759+0000","last_undegraded":"2024-03-19T06:07:02.042759+0000","last_fullsized":"2024-03-19T06:07:02.042759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.603960+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:07:31.603960+0000","last_peered":"2024-03-19T06:07:31.603960+0000","last_clean":"2024-03-19T06:07:31.603960+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:07:31.603960+0000","last_undegraded":"2024-03-19T06:07:31.603960+0000","last_fullsized":"2024-03-19T06:07:31.603960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246888+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:07:02.246888+0000","last_peered":"2024-03-19T06:07:02.246888+0000","last_clean":"2024-03-19T06:07:02.246888+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:07:02.246888+0000","last_undegraded":"2024-03-19T06:07:02.246888+0000","last_fullsized":"2024-03-19T06:07:02.246888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241798+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:07:02.241798+0000","last_peered":"2024-03-19T06:07:02.241798+0000","last_clean":"2024-03-19T06:07:02.241798+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:07:02.241798+0000","last_undegraded":"2024-03-19T06:07:02.241798+0000","last_fullsized":"2024-03-19T06:07:02.241798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.546487+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:07:24.546487+0000","last_peered":"2024-03-19T06:07:24.546487+0000","last_clean":"2024-03-19T06:07:24.546487+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:07:24.546487+0000","last_undegraded":"2024-03-19T06:07:24.546487+0000","last_fullsized":"2024-03-19T06:07:24.546487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002159+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:07:02.002159+0000","last_peered":"2024-03-19T06:07:02.002159+0000","last_clean":"2024-03-19T06:07:02.002159+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:07:02.002159+0000","last_undegraded":"2024-03-19T06:07:02.002159+0000","last_fullsized":"2024-03-19T06:07:02.002159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001301+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:07:02.001301+0000","last_peered":"2024-03-19T06:07:02.001301+0000","last_clean":"2024-03-19T06:07:02.001301+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:07:02.001301+0000","last_undegraded":"2024-03-19T06:07:02.001301+0000","last_fullsized":"2024-03-19T06:07:02.001301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.568774+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:07:24.568774+0000","last_peered":"2024-03-19T06:07:24.568774+0000","last_clean":"2024-03-19T06:07:24.568774+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:07:24.568774+0000","last_undegraded":"2024-03-19T06:07:24.568774+0000","last_fullsized":"2024-03-19T06:07:24.568774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002617+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:07:02.002617+0000","last_peered":"2024-03-19T06:07:02.002617+0000","last_clean":"2024-03-19T06:07:02.002617+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:07:02.002617+0000","last_undegraded":"2024-03-19T06:07:02.002617+0000","last_fullsized":"2024-03-19T06:07:02.002617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044065+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:07:02.044065+0000","last_peered":"2024-03-19T06:07:02.044065+0000","last_clean":"2024-03-19T06:07:02.044065+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:07:02.044065+0000","last_undegraded":"2024-03-19T06:07:02.044065+0000","last_fullsized":"2024-03-19T06:07:02.044065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.560919+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:07:24.560919+0000","last_peered":"2024-03-19T06:07:24.560919+0000","last_clean":"2024-03-19T06:07:24.560919+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:07:24.560919+0000","last_undegraded":"2024-03-19T06:07:24.560919+0000","last_fullsized":"2024-03-19T06:07:24.560919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993250+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:07:01.993250+0000","last_peered":"2024-03-19T06:07:01.993250+0000","last_clean":"2024-03-19T06:07:01.993250+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:07:01.993250+0000","last_undegraded":"2024-03-19T06:07:01.993250+0000","last_fullsized":"2024-03-19T06:07:01.993250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247142+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:07:02.247142+0000","last_peered":"2024-03-19T06:07:02.247142+0000","last_clean":"2024-03-19T06:07:02.247142+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:07:02.247142+0000","last_undegraded":"2024-03-19T06:07:02.247142+0000","last_fullsized":"2024-03-19T06:07:02.247142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.552623+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:07:24.552623+0000","last_peered":"2024-03-19T06:07:24.552623+0000","last_clean":"2024-03-19T06:07:24.552623+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:07:24.552623+0000","last_undegraded":"2024-03-19T06:07:24.552623+0000","last_fullsized":"2024-03-19T06:07:24.552623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992913+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:07:01.992913+0000","last_peered":"2024-03-19T06:07:01.992913+0000","last_clean":"2024-03-19T06:07:01.992913+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:07:01.992913+0000","last_undegraded":"2024-03-19T06:07:01.992913+0000","last_fullsized":"2024-03-19T06:07:01.992913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042627+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:07:02.042627+0000","last_peered":"2024-03-19T06:07:02.042627+0000","last_clean":"2024-03-19T06:07:02.042627+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:07:02.042627+0000","last_undegraded":"2024-03-19T06:07:02.042627+0000","last_fullsized":"2024-03-19T06:07:02.042627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001706+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:07:02.001706+0000","last_peered":"2024-03-19T06:07:02.001706+0000","last_clean":"2024-03-19T06:07:02.001706+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:07:02.001706+0000","last_undegraded":"2024-03-19T06:07:02.001706+0000","last_fullsized":"2024-03-19T06:07:02.001706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561506+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:07:24.561506+0000","last_peered":"2024-03-19T06:07:24.561506+0000","last_clean":"2024-03-19T06:07:24.561506+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:07:24.561506+0000","last_undegraded":"2024-03-19T06:07:24.561506+0000","last_fullsized":"2024-03-19T06:07:24.561506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156234+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:07:02.156234+0000","last_peered":"2024-03-19T06:07:02.156234+0000","last_clean":"2024-03-19T06:07:02.156234+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:07:02.156234+0000","last_undegraded":"2024-03-19T06:07:02.156234+0000","last_fullsized":"2024-03-19T06:07:02.156234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993429+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:07:01.993429+0000","last_peered":"2024-03-19T06:07:01.993429+0000","last_clean":"2024-03-19T06:07:01.993429+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:07:01.993429+0000","last_undegraded":"2024-03-19T06:07:01.993429+0000","last_fullsized":"2024-03-19T06:07:01.993429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.678777+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:07:31.678777+0000","last_peered":"2024-03-19T06:07:31.678777+0000","last_clean":"2024-03-19T06:07:31.678777+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:07:31.678777+0000","last_undegraded":"2024-03-19T06:07:31.678777+0000","last_fullsized":"2024-03-19T06:07:31.678777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.371422+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:07:34.371422+0000","last_peered":"2024-03-19T06:07:34.371422+0000","last_clean":"2024-03-19T06:07:34.371422+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:07:34.371422+0000","last_undegraded":"2024-03-19T06:07:34.371422+0000","last_fullsized":"2024-03-19T06:07:34.371422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043573+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:07:02.043573+0000","last_peered":"2024-03-19T06:07:02.043573+0000","last_clean":"2024-03-19T06:07:02.043573+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:07:02.043573+0000","last_undegraded":"2024-03-19T06:07:02.043573+0000","last_fullsized":"2024-03-19T06:07:02.043573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000236+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:07:02.000236+0000","last_peered":"2024-03-19T06:07:02.000236+0000","last_clean":"2024-03-19T06:07:02.000236+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:07:02.000236+0000","last_undegraded":"2024-03-19T06:07:02.000236+0000","last_fullsized":"2024-03-19T06:07:02.000236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.776946+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:07:24.776946+0000","last_peered":"2024-03-19T06:07:24.776946+0000","last_clean":"2024-03-19T06:07:24.776946+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:07:24.776946+0000","last_undegraded":"2024-03-19T06:07:24.776946+0000","last_fullsized":"2024-03-19T06:07:24.776946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000566+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:07:02.000566+0000","last_peered":"2024-03-19T06:07:02.000566+0000","last_clean":"2024-03-19T06:07:02.000566+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:07:02.000566+0000","last_undegraded":"2024-03-19T06:07:02.000566+0000","last_fullsized":"2024-03-19T06:07:02.000566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995704+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:07:01.995704+0000","last_peered":"2024-03-19T06:07:01.995704+0000","last_clean":"2024-03-19T06:07:01.995704+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:07:01.995704+0000","last_undegraded":"2024-03-19T06:07:01.995704+0000","last_fullsized":"2024-03-19T06:07:01.995704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154044+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:07:02.154044+0000","last_peered":"2024-03-19T06:07:02.154044+0000","last_clean":"2024-03-19T06:07:02.154044+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:07:02.154044+0000","last_undegraded":"2024-03-19T06:07:02.154044+0000","last_fullsized":"2024-03-19T06:07:02.154044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.998953+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:07:01.998953+0000","last_peered":"2024-03-19T06:07:01.998953+0000","last_clean":"2024-03-19T06:07:01.998953+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:07:01.998953+0000","last_undegraded":"2024-03-19T06:07:01.998953+0000","last_fullsized":"2024-03-19T06:07:01.998953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005904+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:07:02.005904+0000","last_peered":"2024-03-19T06:07:02.005904+0000","last_clean":"2024-03-19T06:07:02.005904+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:07:02.005904+0000","last_undegraded":"2024-03-19T06:07:02.005904+0000","last_fullsized":"2024-03-19T06:07:02.005904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043348+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:07:02.043348+0000","last_peered":"2024-03-19T06:07:02.043348+0000","last_clean":"2024-03-19T06:07:02.043348+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:07:02.043348+0000","last_undegraded":"2024-03-19T06:07:02.043348+0000","last_fullsized":"2024-03-19T06:07:02.043348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995602+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:07:01.995602+0000","last_peered":"2024-03-19T06:07:01.995602+0000","last_clean":"2024-03-19T06:07:01.995602+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:07:01.995602+0000","last_undegraded":"2024-03-19T06:07:01.995602+0000","last_fullsized":"2024-03-19T06:07:01.995602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004568+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:07:02.004568+0000","last_peered":"2024-03-19T06:07:02.004568+0000","last_clean":"2024-03-19T06:07:02.004568+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:07:02.004568+0000","last_undegraded":"2024-03-19T06:07:02.004568+0000","last_fullsized":"2024-03-19T06:07:02.004568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156237+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:07:02.156237+0000","last_peered":"2024-03-19T06:07:02.156237+0000","last_clean":"2024-03-19T06:07:02.156237+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:07:02.156237+0000","last_undegraded":"2024-03-19T06:07:02.156237+0000","last_fullsized":"2024-03-19T06:07:02.156237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997230+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:07:01.997230+0000","last_peered":"2024-03-19T06:07:01.997230+0000","last_clean":"2024-03-19T06:07:01.997230+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:07:01.997230+0000","last_undegraded":"2024-03-19T06:07:01.997230+0000","last_fullsized":"2024-03-19T06:07:01.997230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244587+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:07:02.244587+0000","last_peered":"2024-03-19T06:07:02.244587+0000","last_clean":"2024-03-19T06:07:02.244587+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:07:02.244587+0000","last_undegraded":"2024-03-19T06:07:02.244587+0000","last_fullsized":"2024-03-19T06:07:02.244587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993231+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:07:01.993231+0000","last_peered":"2024-03-19T06:07:01.993231+0000","last_clean":"2024-03-19T06:07:01.993231+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:07:01.993231+0000","last_undegraded":"2024-03-19T06:07:01.993231+0000","last_fullsized":"2024-03-19T06:07:01.993231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246075+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:07:02.246075+0000","last_peered":"2024-03-19T06:07:02.246075+0000","last_clean":"2024-03-19T06:07:02.246075+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:07:02.246075+0000","last_undegraded":"2024-03-19T06:07:02.246075+0000","last_fullsized":"2024-03-19T06:07:02.246075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042839+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:07:02.042839+0000","last_peered":"2024-03-19T06:07:02.042839+0000","last_clean":"2024-03-19T06:07:02.042839+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:07:02.042839+0000","last_undegraded":"2024-03-19T06:07:02.042839+0000","last_fullsized":"2024-03-19T06:07:02.042839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154779+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:07:02.154779+0000","last_peered":"2024-03-19T06:07:02.154779+0000","last_clean":"2024-03-19T06:07:02.154779+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:07:02.154779+0000","last_undegraded":"2024-03-19T06:07:02.154779+0000","last_fullsized":"2024-03-19T06:07:02.154779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242289+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:07:02.242289+0000","last_peered":"2024-03-19T06:07:02.242289+0000","last_clean":"2024-03-19T06:07:02.242289+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:07:02.242289+0000","last_undegraded":"2024-03-19T06:07:02.242289+0000","last_fullsized":"2024-03-19T06:07:02.242289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000126+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:07:02.000126+0000","last_peered":"2024-03-19T06:07:02.000126+0000","last_clean":"2024-03-19T06:07:02.000126+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:07:02.000126+0000","last_undegraded":"2024-03-19T06:07:02.000126+0000","last_fullsized":"2024-03-19T06:07:02.000126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247072+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:07:02.247072+0000","last_peered":"2024-03-19T06:07:02.247072+0000","last_clean":"2024-03-19T06:07:02.247072+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:07:02.247072+0000","last_undegraded":"2024-03-19T06:07:02.247072+0000","last_fullsized":"2024-03-19T06:07:02.247072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244557+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:07:02.244557+0000","last_peered":"2024-03-19T06:07:02.244557+0000","last_clean":"2024-03-19T06:07:02.244557+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:07:02.244557+0000","last_undegraded":"2024-03-19T06:07:02.244557+0000","last_fullsized":"2024-03-19T06:07:02.244557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001833+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:07:02.001833+0000","last_peered":"2024-03-19T06:07:02.001833+0000","last_clean":"2024-03-19T06:07:02.001833+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:07:02.001833+0000","last_undegraded":"2024-03-19T06:07:02.001833+0000","last_fullsized":"2024-03-19T06:07:02.001833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042647+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:07:02.042647+0000","last_peered":"2024-03-19T06:07:02.042647+0000","last_clean":"2024-03-19T06:07:02.042647+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:07:02.042647+0000","last_undegraded":"2024-03-19T06:07:02.042647+0000","last_fullsized":"2024-03-19T06:07:02.042647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.162102+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:07:02.162102+0000","last_peered":"2024-03-19T06:07:02.162102+0000","last_clean":"2024-03-19T06:07:02.162102+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:07:02.162102+0000","last_undegraded":"2024-03-19T06:07:02.162102+0000","last_fullsized":"2024-03-19T06:07:02.162102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001286+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:07:02.001286+0000","last_peered":"2024-03-19T06:07:02.001286+0000","last_clean":"2024-03-19T06:07:02.001286+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:07:02.001286+0000","last_undegraded":"2024-03-19T06:07:02.001286+0000","last_fullsized":"2024-03-19T06:07:02.001286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155928+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:07:02.155928+0000","last_peered":"2024-03-19T06:07:02.155928+0000","last_clean":"2024-03-19T06:07:02.155928+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:07:02.155928+0000","last_undegraded":"2024-03-19T06:07:02.155928+0000","last_fullsized":"2024-03-19T06:07:02.155928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156135+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:07:02.156135+0000","last_peered":"2024-03-19T06:07:02.156135+0000","last_clean":"2024-03-19T06:07:02.156135+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:07:02.156135+0000","last_undegraded":"2024-03-19T06:07:02.156135+0000","last_fullsized":"2024-03-19T06:07:02.156135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242863+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:07:02.242863+0000","last_peered":"2024-03-19T06:07:02.242863+0000","last_clean":"2024-03-19T06:07:02.242863+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:07:02.242863+0000","last_undegraded":"2024-03-19T06:07:02.242863+0000","last_fullsized":"2024-03-19T06:07:02.242863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993019+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:07:01.993019+0000","last_peered":"2024-03-19T06:07:01.993019+0000","last_clean":"2024-03-19T06:07:01.993019+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:07:01.993019+0000","last_undegraded":"2024-03-19T06:07:01.993019+0000","last_fullsized":"2024-03-19T06:07:01.993019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240899+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:07:02.240899+0000","last_peered":"2024-03-19T06:07:02.240899+0000","last_clean":"2024-03-19T06:07:02.240899+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:07:02.240899+0000","last_undegraded":"2024-03-19T06:07:02.240899+0000","last_fullsized":"2024-03-19T06:07:02.240899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.047146+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:07:02.047146+0000","last_peered":"2024-03-19T06:07:02.047146+0000","last_clean":"2024-03-19T06:07:02.047146+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:07:02.047146+0000","last_undegraded":"2024-03-19T06:07:02.047146+0000","last_fullsized":"2024-03-19T06:07:02.047146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241517+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:07:02.241517+0000","last_peered":"2024-03-19T06:07:02.241517+0000","last_clean":"2024-03-19T06:07:02.241517+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:07:02.241517+0000","last_undegraded":"2024-03-19T06:07:02.241517+0000","last_fullsized":"2024-03-19T06:07:02.241517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247855+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:07:02.247855+0000","last_peered":"2024-03-19T06:07:02.247855+0000","last_clean":"2024-03-19T06:07:02.247855+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:07:02.247855+0000","last_undegraded":"2024-03-19T06:07:02.247855+0000","last_fullsized":"2024-03-19T06:07:02.247855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043112+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:07:02.043112+0000","last_peered":"2024-03-19T06:07:02.043112+0000","last_clean":"2024-03-19T06:07:02.043112+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:07:02.043112+0000","last_undegraded":"2024-03-19T06:07:02.043112+0000","last_fullsized":"2024-03-19T06:07:02.043112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005165+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:07:02.005165+0000","last_peered":"2024-03-19T06:07:02.005165+0000","last_clean":"2024-03-19T06:07:02.005165+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:07:02.005165+0000","last_undegraded":"2024-03-19T06:07:02.005165+0000","last_fullsized":"2024-03-19T06:07:02.005165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.161673+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:07:02.161673+0000","last_peered":"2024-03-19T06:07:02.161673+0000","last_clean":"2024-03-19T06:07:02.161673+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:07:02.161673+0000","last_undegraded":"2024-03-19T06:07:02.161673+0000","last_fullsized":"2024-03-19T06:07:02.161673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8858,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":17716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":733305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476759,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":144327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":142929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476758,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":146243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":146231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":143005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":142543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":732661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:07:40.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:07:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.402+0000 7f2bda400640 1 Processor -- start 2024-03-19T06:07:40.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.402+0000 7f2bda400640 1 -- start start 2024-03-19T06:07:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.403+0000 7f2bda400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2bd40717c0 0x7f2bd40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.404+0000 7f2bda400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2bd40c5c50 0x7f2bd415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.404+0000 7f2bda400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd41541d0 con 0x7f2bd4153df0 2024-03-19T06:07:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.404+0000 7f2bda400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd4159a50 con 0x7f2bd40c5c50 2024-03-19T06:07:40.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.404+0000 7f2bda400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd40c6b80 con 0x7f2bd40717c0 2024-03-19T06:07:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.404+0000 7f2bd9a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2bd40c5c50 0x7f2bd415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.405+0000 7f2bd9a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2bd40c5c50 0x7f2bd415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59688/0 (socket says 172.21.15.17:59688) 2024-03-19T06:07:40.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.405+0000 7f2bd9a00640 1 -- 172.21.15.17:0/1206589883 learned_addr learned my addr 172.21.15.17:0/1206589883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:40.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.408+0000 7f2bd9a00640 1 -- 172.21.15.17:0/1206589883 >> v2:172.21.15.153:3300/0 conn(0x7f2bd40717c0 msgr2=0x7f2bd40c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:40.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.408+0000 7f2bd9a00640 1 --2- 172.21.15.17:0/1206589883 >> v2:172.21.15.153:3300/0 conn(0x7f2bd40717c0 0x7f2bd40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.408+0000 7f2bd9a00640 1 -- 172.21.15.17:0/1206589883 >> v1:172.21.15.153:6789/0 conn(0x7f2bd4153df0 legacy=0x7f2bd40710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:40.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.408+0000 7f2bd9a00640 1 -- 172.21.15.17:0/1206589883 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40c6e60 con 0x7f2bd40c5c50 2024-03-19T06:07:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.410+0000 7f2bd9a00640 1 --2- 172.21.15.17:0/1206589883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd415d020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4070100 tx=0x7f2bcc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cfd8ee72197bd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.414+0000 7f2bd3e00640 1 -- 172.21.15.17:0/1206589883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc02cb20 con 0x7f2bd40c5c50 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.414+0000 7f2bd3e00640 1 -- 172.21.15.17:0/1206589883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc02ccc0 con 0x7f2bd40c5c50 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.414+0000 7f2bd3e00640 1 -- 172.21.15.17:0/1206589883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc034610 con 0x7f2bd40c5c50 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 -- 172.21.15.17:0/1206589883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 msgr2=0x7f2bd415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 --2- 172.21.15.17:0/1206589883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd415d020 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4070100 tx=0x7f2bcc02bf80 comp rx=0 tx=0).stop 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 -- 172.21.15.17:0/1206589883 shutdown_connections 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 --2- 172.21.15.17:0/1206589883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd415d020 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 --2- 172.21.15.17:0/1206589883 >> v2:172.21.15.153:3300/0 conn(0x7f2bd40717c0 0x7f2bd40c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 -- 172.21.15.17:0/1206589883 >> 172.21.15.17:0/1206589883 conn(0x7f2bd406e630 msgr2=0x7f2bd406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 -- 172.21.15.17:0/1206589883 shutdown_connections 2024-03-19T06:07:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.415+0000 7f2bda400640 1 -- 172.21.15.17:0/1206589883 wait complete. 2024-03-19T06:07:40.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.417+0000 7f2bda400640 1 Processor -- start 2024-03-19T06:07:40.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.418+0000 7f2bda400640 1 -- start start 2024-03-19T06:07:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2bd40717c0 0x7f2bd41e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd4153df0 0x7f2bd41e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4159ff0 con 0x7f2bd40c5c50 2024-03-19T06:07:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd4159d10 con 0x7f2bd4153df0 2024-03-19T06:07:40.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.419+0000 7f2bda400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c65d0 con 0x7f2bd40717c0 2024-03-19T06:07:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.420+0000 7f2bcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.420+0000 7f2bcbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59696/0 (socket says 172.21.15.17:59696) 2024-03-19T06:07:40.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.420+0000 7f2bcbe00640 1 -- 172.21.15.17:0/2173779997 learned_addr learned my addr 172.21.15.17:0/2173779997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.424+0000 7f2bcbe00640 1 -- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2bd40717c0 msgr2=0x7f2bd41e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.424+0000 7f2bcbe00640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2bd40717c0 0x7f2bd41e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.424+0000 7f2bcbe00640 1 -- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd4153df0 msgr2=0x7f2bd41e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.424+0000 7f2bcbe00640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd4153df0 0x7f2bd41e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:40.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.424+0000 7f2bcbe00640 1 -- 172.21.15.17:0/2173779997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40cad50 con 0x7f2bd40c5c50 2024-03-19T06:07:40.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.427+0000 7f2bcbe00640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b480 tx=0x7f2bbc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.431+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc015020 con 0x7f2bd40c5c50 2024-03-19T06:07:40.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.431+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc011830 con 0x7f2bd40c5c50 2024-03-19T06:07:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.431+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc011c20 con 0x7f2bd40c5c50 2024-03-19T06:07:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.431+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd40cb030 con 0x7f2bd40c5c50 2024-03-19T06:07:40.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.431+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd40cb5f0 con 0x7f2bd40c5c50 2024-03-19T06:07:40.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.432+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd40686e0 con 0x7f2bd40c5c50 2024-03-19T06:07:40.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.454+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2bbc018020 con 0x7f2bd40c5c50 2024-03-19T06:07:40.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.456+0000 7f2bd1600640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 0x7f2bb006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:40.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.457+0000 7f2bd9000640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 0x7f2bb006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:40.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.458+0000 7f2bd9000640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 0x7f2bb006e110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009650 tx=0x7f2bc4006ba0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:40.540 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-03-19T06:07:40.548+0000 f5ec640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-19T06:07:40.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.784+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2bbc021de0 con 0x7f2bd40c5c50 2024-03-19T06:07:40.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.785+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f2bbc01f020 con 0x7f2bd40c5c50 2024-03-19T06:07:40.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:40.995+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bd404f050 con 0x7f2bb006bc50 2024-03-19T06:07:41.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.018+0000 7f2bd1600640 1 -- 172.21.15.17:0/2173779997 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332614 (secure 0 0 0) 0x7f2bd404f050 con 0x7f2bb006bc50 2024-03-19T06:07:41.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:41.017 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:07:41.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 msgr2=0x7f2bb006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 0x7f2bb006e110 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009650 tx=0x7f2bc4006ba0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 msgr2=0x7f2bd41e2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00b480 tx=0x7f2bbc00b940 comp rx=0 tx=0).stop 2024-03-19T06:07:41.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 shutdown_connections 2024-03-19T06:07:41.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2bb006bc50 0x7f2bb006e110 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd4153df0 0x7f2bd41e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bd40c5c50 0x7f2bd41e2ff0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 --2- 172.21.15.17:0/2173779997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2bd40717c0 0x7f2bd41e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 >> 172.21.15.17:0/2173779997 conn(0x7f2bd406e630 msgr2=0x7f2bd4073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.025+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 shutdown_connections 2024-03-19T06:07:41.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.026+0000 7f2bda400640 1 -- 172.21.15.17:0/2173779997 wait complete. 2024-03-19T06:07:41.035 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-03-19T06:07:39.322944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599226,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":328,"num_write_kb":2472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236792,"kb_used_data":4024,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737928,"statfs":{"total":773094113280,"available":772851638272,"internally_reserved":0,"allocated":4120576,"data_stored":2331244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3456,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004525"},"pg_stats":[{"pgid":"2.1f","version":"32'11","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.404041+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:07:34.404041+0000","last_peered":"2024-03-19T06:07:34.404041+0000","last_clean":"2024-03-19T06:07:34.404041+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:07:34.404041+0000","last_undegraded":"2024-03-19T06:07:34.404041+0000","last_fullsized":"2024-03-19T06:07:34.404041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996193+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:07:01.996193+0000","last_peered":"2024-03-19T06:07:01.996193+0000","last_clean":"2024-03-19T06:07:01.996193+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:07:01.996193+0000","last_undegraded":"2024-03-19T06:07:01.996193+0000","last_fullsized":"2024-03-19T06:07:01.996193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992725+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:07:01.992725+0000","last_peered":"2024-03-19T06:07:01.992725+0000","last_clean":"2024-03-19T06:07:01.992725+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:07:01.992725+0000","last_undegraded":"2024-03-19T06:07:01.992725+0000","last_fullsized":"2024-03-19T06:07:01.992725+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.996674+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:07:01.996674+0000","last_peered":"2024-03-19T06:07:01.996674+0000","last_clean":"2024-03-19T06:07:01.996674+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:07:01.996674+0000","last_undegraded":"2024-03-19T06:07:01.996674+0000","last_fullsized":"2024-03-19T06:07:01.996674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043882+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:07:02.043882+0000","last_peered":"2024-03-19T06:07:02.043882+0000","last_clean":"2024-03-19T06:07:02.043882+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:07:02.043882+0000","last_undegraded":"2024-03-19T06:07:02.043882+0000","last_fullsized":"2024-03-19T06:07:02.043882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999673+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:07:01.999673+0000","last_peered":"2024-03-19T06:07:01.999673+0000","last_clean":"2024-03-19T06:07:01.999673+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:07:01.999673+0000","last_undegraded":"2024-03-19T06:07:01.999673+0000","last_fullsized":"2024-03-19T06:07:01.999673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.361948+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:07:34.361948+0000","last_peered":"2024-03-19T06:07:34.361948+0000","last_clean":"2024-03-19T06:07:34.361948+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:07:34.361948+0000","last_undegraded":"2024-03-19T06:07:34.361948+0000","last_fullsized":"2024-03-19T06:07:34.361948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247982+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:07:02.247982+0000","last_peered":"2024-03-19T06:07:02.247982+0000","last_clean":"2024-03-19T06:07:02.247982+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:07:02.247982+0000","last_undegraded":"2024-03-19T06:07:02.247982+0000","last_fullsized":"2024-03-19T06:07:02.247982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.159056+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:07:02.159056+0000","last_peered":"2024-03-19T06:07:02.159056+0000","last_clean":"2024-03-19T06:07:02.159056+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:07:02.159056+0000","last_undegraded":"2024-03-19T06:07:02.159056+0000","last_fullsized":"2024-03-19T06:07:02.159056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"25'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241176+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:07:02.241176+0000","last_peered":"2024-03-19T06:07:02.241176+0000","last_clean":"2024-03-19T06:07:02.241176+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:07:02.241176+0000","last_undegraded":"2024-03-19T06:07:02.241176+0000","last_fullsized":"2024-03-19T06:07:02.241176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247222+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:07:02.247222+0000","last_peered":"2024-03-19T06:07:02.247222+0000","last_clean":"2024-03-19T06:07:02.247222+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:07:02.247222+0000","last_undegraded":"2024-03-19T06:07:02.247222+0000","last_fullsized":"2024-03-19T06:07:02.247222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000220+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:07:02.000220+0000","last_peered":"2024-03-19T06:07:02.000220+0000","last_clean":"2024-03-19T06:07:02.000220+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:07:02.000220+0000","last_undegraded":"2024-03-19T06:07:02.000220+0000","last_fullsized":"2024-03-19T06:07:02.000220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154988+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:07:02.154988+0000","last_peered":"2024-03-19T06:07:02.154988+0000","last_clean":"2024-03-19T06:07:02.154988+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:07:02.154988+0000","last_undegraded":"2024-03-19T06:07:02.154988+0000","last_fullsized":"2024-03-19T06:07:02.154988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.566454+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:07:24.566454+0000","last_peered":"2024-03-19T06:07:24.566454+0000","last_clean":"2024-03-19T06:07:24.566454+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:07:24.566454+0000","last_undegraded":"2024-03-19T06:07:24.566454+0000","last_fullsized":"2024-03-19T06:07:24.566454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000701+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:07:02.000701+0000","last_peered":"2024-03-19T06:07:02.000701+0000","last_clean":"2024-03-19T06:07:02.000701+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:07:02.000701+0000","last_undegraded":"2024-03-19T06:07:02.000701+0000","last_fullsized":"2024-03-19T06:07:02.000701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.994372+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:07:01.994372+0000","last_peered":"2024-03-19T06:07:01.994372+0000","last_clean":"2024-03-19T06:07:01.994372+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:07:01.994372+0000","last_undegraded":"2024-03-19T06:07:01.994372+0000","last_fullsized":"2024-03-19T06:07:01.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.088539+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:07:31.088539+0000","last_peered":"2024-03-19T06:07:31.088539+0000","last_clean":"2024-03-19T06:07:31.088539+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:07:31.088539+0000","last_undegraded":"2024-03-19T06:07:31.088539+0000","last_fullsized":"2024-03-19T06:07:31.088539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001560+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:07:02.001560+0000","last_peered":"2024-03-19T06:07:02.001560+0000","last_clean":"2024-03-19T06:07:02.001560+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:07:02.001560+0000","last_undegraded":"2024-03-19T06:07:02.001560+0000","last_fullsized":"2024-03-19T06:07:02.001560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993604+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:07:01.993604+0000","last_peered":"2024-03-19T06:07:01.993604+0000","last_clean":"2024-03-19T06:07:01.993604+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:07:01.993604+0000","last_undegraded":"2024-03-19T06:07:01.993604+0000","last_fullsized":"2024-03-19T06:07:01.993604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.358159+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:07:34.358159+0000","last_peered":"2024-03-19T06:07:34.358159+0000","last_clean":"2024-03-19T06:07:34.358159+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:07:34.358159+0000","last_undegraded":"2024-03-19T06:07:34.358159+0000","last_fullsized":"2024-03-19T06:07:34.358159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004757+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:07:02.004757+0000","last_peered":"2024-03-19T06:07:02.004757+0000","last_clean":"2024-03-19T06:07:02.004757+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:07:02.004757+0000","last_undegraded":"2024-03-19T06:07:02.004757+0000","last_fullsized":"2024-03-19T06:07:02.004757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000136+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:07:02.000136+0000","last_peered":"2024-03-19T06:07:02.000136+0000","last_clean":"2024-03-19T06:07:02.000136+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:07:02.000136+0000","last_undegraded":"2024-03-19T06:07:02.000136+0000","last_fullsized":"2024-03-19T06:07:02.000136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.567976+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:07:24.567976+0000","last_peered":"2024-03-19T06:07:24.567976+0000","last_clean":"2024-03-19T06:07:24.567976+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:07:24.567976+0000","last_undegraded":"2024-03-19T06:07:24.567976+0000","last_fullsized":"2024-03-19T06:07:24.567976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001003+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:07:02.001003+0000","last_peered":"2024-03-19T06:07:02.001003+0000","last_clean":"2024-03-19T06:07:02.001003+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:07:02.001003+0000","last_undegraded":"2024-03-19T06:07:02.001003+0000","last_fullsized":"2024-03-19T06:07:02.001003+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043713+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:07:02.043713+0000","last_peered":"2024-03-19T06:07:02.043713+0000","last_clean":"2024-03-19T06:07:02.043713+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:07:02.043713+0000","last_undegraded":"2024-03-19T06:07:02.043713+0000","last_fullsized":"2024-03-19T06:07:02.043713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.551709+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:07:24.551709+0000","last_peered":"2024-03-19T06:07:24.551709+0000","last_clean":"2024-03-19T06:07:24.551709+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:07:24.551709+0000","last_undegraded":"2024-03-19T06:07:24.551709+0000","last_fullsized":"2024-03-19T06:07:24.551709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000323+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:07:02.000323+0000","last_peered":"2024-03-19T06:07:02.000323+0000","last_clean":"2024-03-19T06:07:02.000323+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:07:02.000323+0000","last_undegraded":"2024-03-19T06:07:02.000323+0000","last_fullsized":"2024-03-19T06:07:02.000323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997387+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:07:01.997387+0000","last_peered":"2024-03-19T06:07:01.997387+0000","last_clean":"2024-03-19T06:07:01.997387+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:07:01.997387+0000","last_undegraded":"2024-03-19T06:07:01.997387+0000","last_fullsized":"2024-03-19T06:07:01.997387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.361827+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:07:34.361827+0000","last_peered":"2024-03-19T06:07:34.361827+0000","last_clean":"2024-03-19T06:07:34.361827+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:07:34.361827+0000","last_undegraded":"2024-03-19T06:07:34.361827+0000","last_fullsized":"2024-03-19T06:07:34.361827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246594+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:07:02.246594+0000","last_peered":"2024-03-19T06:07:02.246594+0000","last_clean":"2024-03-19T06:07:02.246594+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:07:02.246594+0000","last_undegraded":"2024-03-19T06:07:02.246594+0000","last_fullsized":"2024-03-19T06:07:02.246594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004937+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:07:02.004937+0000","last_peered":"2024-03-19T06:07:02.004937+0000","last_clean":"2024-03-19T06:07:02.004937+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:07:02.004937+0000","last_undegraded":"2024-03-19T06:07:02.004937+0000","last_fullsized":"2024-03-19T06:07:02.004937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.360551+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:07:34.360551+0000","last_peered":"2024-03-19T06:07:34.360551+0000","last_clean":"2024-03-19T06:07:34.360551+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:07:34.360551+0000","last_undegraded":"2024-03-19T06:07:34.360551+0000","last_fullsized":"2024-03-19T06:07:34.360551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042542+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:07:02.042542+0000","last_peered":"2024-03-19T06:07:02.042542+0000","last_clean":"2024-03-19T06:07:02.042542+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:07:02.042542+0000","last_undegraded":"2024-03-19T06:07:02.042542+0000","last_fullsized":"2024-03-19T06:07:02.042542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247206+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:07:02.247206+0000","last_peered":"2024-03-19T06:07:02.247206+0000","last_clean":"2024-03-19T06:07:02.247206+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:07:02.247206+0000","last_undegraded":"2024-03-19T06:07:02.247206+0000","last_fullsized":"2024-03-19T06:07:02.247206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005407+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:07:02.005407+0000","last_peered":"2024-03-19T06:07:02.005407+0000","last_clean":"2024-03-19T06:07:02.005407+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:07:02.005407+0000","last_undegraded":"2024-03-19T06:07:02.005407+0000","last_fullsized":"2024-03-19T06:07:02.005407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002045+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:07:02.002045+0000","last_peered":"2024-03-19T06:07:02.002045+0000","last_clean":"2024-03-19T06:07:02.002045+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:07:02.002045+0000","last_undegraded":"2024-03-19T06:07:02.002045+0000","last_fullsized":"2024-03-19T06:07:02.002045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002384+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:07:02.002384+0000","last_peered":"2024-03-19T06:07:02.002384+0000","last_clean":"2024-03-19T06:07:02.002384+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:07:02.002384+0000","last_undegraded":"2024-03-19T06:07:02.002384+0000","last_fullsized":"2024-03-19T06:07:02.002384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'1","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246801+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:07:02.246801+0000","last_peered":"2024-03-19T06:07:02.246801+0000","last_clean":"2024-03-19T06:07:02.246801+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:07:02.246801+0000","last_undegraded":"2024-03-19T06:07:02.246801+0000","last_fullsized":"2024-03-19T06:07:02.246801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004767+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:07:02.004767+0000","last_peered":"2024-03-19T06:07:02.004767+0000","last_clean":"2024-03-19T06:07:02.004767+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:07:02.004767+0000","last_undegraded":"2024-03-19T06:07:02.004767+0000","last_fullsized":"2024-03-19T06:07:02.004767+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002256+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:07:02.002256+0000","last_peered":"2024-03-19T06:07:02.002256+0000","last_clean":"2024-03-19T06:07:02.002256+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:07:02.002256+0000","last_undegraded":"2024-03-19T06:07:02.002256+0000","last_fullsized":"2024-03-19T06:07:02.002256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.679888+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:07:31.679888+0000","last_peered":"2024-03-19T06:07:31.679888+0000","last_clean":"2024-03-19T06:07:31.679888+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:07:31.679888+0000","last_undegraded":"2024-03-19T06:07:31.679888+0000","last_fullsized":"2024-03-19T06:07:31.679888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004938+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:07:02.004938+0000","last_peered":"2024-03-19T06:07:02.004938+0000","last_clean":"2024-03-19T06:07:02.004938+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:07:02.004938+0000","last_undegraded":"2024-03-19T06:07:02.004938+0000","last_fullsized":"2024-03-19T06:07:02.004938+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042134+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:07:02.042134+0000","last_peered":"2024-03-19T06:07:02.042134+0000","last_clean":"2024-03-19T06:07:02.042134+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:07:02.042134+0000","last_undegraded":"2024-03-19T06:07:02.042134+0000","last_fullsized":"2024-03-19T06:07:02.042134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.652118+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:07:31.652118+0000","last_peered":"2024-03-19T06:07:31.652118+0000","last_clean":"2024-03-19T06:07:31.652118+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:07:31.652118+0000","last_undegraded":"2024-03-19T06:07:31.652118+0000","last_fullsized":"2024-03-19T06:07:31.652118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043281+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:07:02.043281+0000","last_peered":"2024-03-19T06:07:02.043281+0000","last_clean":"2024-03-19T06:07:02.043281+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:07:02.043281+0000","last_undegraded":"2024-03-19T06:07:02.043281+0000","last_fullsized":"2024-03-19T06:07:02.043281+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993253+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:07:01.993253+0000","last_peered":"2024-03-19T06:07:01.993253+0000","last_clean":"2024-03-19T06:07:01.993253+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:07:01.993253+0000","last_undegraded":"2024-03-19T06:07:01.993253+0000","last_fullsized":"2024-03-19T06:07:01.993253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.189508+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:07:34.189508+0000","last_peered":"2024-03-19T06:07:34.189508+0000","last_clean":"2024-03-19T06:07:34.189508+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:07:34.189508+0000","last_undegraded":"2024-03-19T06:07:34.189508+0000","last_fullsized":"2024-03-19T06:07:34.189508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240669+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:07:02.240669+0000","last_peered":"2024-03-19T06:07:02.240669+0000","last_clean":"2024-03-19T06:07:02.240669+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:07:02.240669+0000","last_undegraded":"2024-03-19T06:07:02.240669+0000","last_fullsized":"2024-03-19T06:07:02.240669+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155726+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:07:02.155726+0000","last_peered":"2024-03-19T06:07:02.155726+0000","last_clean":"2024-03-19T06:07:02.155726+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:07:02.155726+0000","last_undegraded":"2024-03-19T06:07:02.155726+0000","last_fullsized":"2024-03-19T06:07:02.155726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241852+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:07:02.241852+0000","last_peered":"2024-03-19T06:07:02.241852+0000","last_clean":"2024-03-19T06:07:02.241852+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:07:02.241852+0000","last_undegraded":"2024-03-19T06:07:02.241852+0000","last_fullsized":"2024-03-19T06:07:02.241852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.189348+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:07:34.189348+0000","last_peered":"2024-03-19T06:07:34.189348+0000","last_clean":"2024-03-19T06:07:34.189348+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:07:34.189348+0000","last_undegraded":"2024-03-19T06:07:34.189348+0000","last_fullsized":"2024-03-19T06:07:34.189348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154712+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:07:02.154712+0000","last_peered":"2024-03-19T06:07:02.154712+0000","last_clean":"2024-03-19T06:07:02.154712+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:07:02.154712+0000","last_undegraded":"2024-03-19T06:07:02.154712+0000","last_fullsized":"2024-03-19T06:07:02.154712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.248178+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:07:02.248178+0000","last_peered":"2024-03-19T06:07:02.248178+0000","last_clean":"2024-03-19T06:07:02.248178+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:07:02.248178+0000","last_undegraded":"2024-03-19T06:07:02.248178+0000","last_fullsized":"2024-03-19T06:07:02.248178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005304+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:07:02.005304+0000","last_peered":"2024-03-19T06:07:02.005304+0000","last_clean":"2024-03-19T06:07:02.005304+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:07:02.005304+0000","last_undegraded":"2024-03-19T06:07:02.005304+0000","last_fullsized":"2024-03-19T06:07:02.005304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043106+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:07:02.043106+0000","last_peered":"2024-03-19T06:07:02.043106+0000","last_clean":"2024-03-19T06:07:02.043106+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:07:02.043106+0000","last_undegraded":"2024-03-19T06:07:02.043106+0000","last_fullsized":"2024-03-19T06:07:02.043106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242959+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:07:02.242959+0000","last_peered":"2024-03-19T06:07:02.242959+0000","last_clean":"2024-03-19T06:07:02.242959+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:07:02.242959+0000","last_undegraded":"2024-03-19T06:07:02.242959+0000","last_fullsized":"2024-03-19T06:07:02.242959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'3","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000486+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:07:02.000486+0000","last_peered":"2024-03-19T06:07:02.000486+0000","last_clean":"2024-03-19T06:07:02.000486+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:07:02.000486+0000","last_undegraded":"2024-03-19T06:07:02.000486+0000","last_fullsized":"2024-03-19T06:07:02.000486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244381+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:07:02.244381+0000","last_peered":"2024-03-19T06:07:02.244381+0000","last_clean":"2024-03-19T06:07:02.244381+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:07:02.244381+0000","last_undegraded":"2024-03-19T06:07:02.244381+0000","last_fullsized":"2024-03-19T06:07:02.244381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242409+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:07:02.242409+0000","last_peered":"2024-03-19T06:07:02.242409+0000","last_clean":"2024-03-19T06:07:02.242409+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:07:02.242409+0000","last_undegraded":"2024-03-19T06:07:02.242409+0000","last_fullsized":"2024-03-19T06:07:02.242409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001979+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:07:02.001979+0000","last_peered":"2024-03-19T06:07:02.001979+0000","last_clean":"2024-03-19T06:07:02.001979+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:07:02.001979+0000","last_undegraded":"2024-03-19T06:07:02.001979+0000","last_fullsized":"2024-03-19T06:07:02.001979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.999778+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:07:01.999778+0000","last_peered":"2024-03-19T06:07:01.999778+0000","last_clean":"2024-03-19T06:07:01.999778+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:07:01.999778+0000","last_undegraded":"2024-03-19T06:07:01.999778+0000","last_fullsized":"2024-03-19T06:07:01.999778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240955+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:07:02.240955+0000","last_peered":"2024-03-19T06:07:02.240955+0000","last_clean":"2024-03-19T06:07:02.240955+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:07:02.240955+0000","last_undegraded":"2024-03-19T06:07:02.240955+0000","last_fullsized":"2024-03-19T06:07:02.240955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'16","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.678216+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:07:31.678216+0000","last_peered":"2024-03-19T06:07:31.678216+0000","last_clean":"2024-03-19T06:07:31.678216+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:07:31.678216+0000","last_undegraded":"2024-03-19T06:07:31.678216+0000","last_fullsized":"2024-03-19T06:07:31.678216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043013+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:07:02.043013+0000","last_peered":"2024-03-19T06:07:02.043013+0000","last_clean":"2024-03-19T06:07:02.043013+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:07:02.043013+0000","last_undegraded":"2024-03-19T06:07:02.043013+0000","last_fullsized":"2024-03-19T06:07:02.043013+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154227+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:07:02.154227+0000","last_peered":"2024-03-19T06:07:02.154227+0000","last_clean":"2024-03-19T06:07:02.154227+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:07:02.154227+0000","last_undegraded":"2024-03-19T06:07:02.154227+0000","last_fullsized":"2024-03-19T06:07:02.154227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.370841+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:07:34.370841+0000","last_peered":"2024-03-19T06:07:34.370841+0000","last_clean":"2024-03-19T06:07:34.370841+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:07:34.370841+0000","last_undegraded":"2024-03-19T06:07:34.370841+0000","last_fullsized":"2024-03-19T06:07:34.370841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997053+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:07:01.997053+0000","last_peered":"2024-03-19T06:07:01.997053+0000","last_clean":"2024-03-19T06:07:01.997053+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:07:01.997053+0000","last_undegraded":"2024-03-19T06:07:01.997053+0000","last_fullsized":"2024-03-19T06:07:01.997053+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242714+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:07:02.242714+0000","last_peered":"2024-03-19T06:07:02.242714+0000","last_clean":"2024-03-19T06:07:02.242714+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:07:02.242714+0000","last_undegraded":"2024-03-19T06:07:02.242714+0000","last_fullsized":"2024-03-19T06:07:02.242714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.563715+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:07:24.563715+0000","last_peered":"2024-03-19T06:07:24.563715+0000","last_clean":"2024-03-19T06:07:24.563715+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:07:24.563715+0000","last_undegraded":"2024-03-19T06:07:24.563715+0000","last_fullsized":"2024-03-19T06:07:24.563715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.251618+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:07:02.251618+0000","last_peered":"2024-03-19T06:07:02.251618+0000","last_clean":"2024-03-19T06:07:02.251618+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:07:02.251618+0000","last_undegraded":"2024-03-19T06:07:02.251618+0000","last_fullsized":"2024-03-19T06:07:02.251618+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042759+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:07:02.042759+0000","last_peered":"2024-03-19T06:07:02.042759+0000","last_clean":"2024-03-19T06:07:02.042759+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:07:02.042759+0000","last_undegraded":"2024-03-19T06:07:02.042759+0000","last_fullsized":"2024-03-19T06:07:02.042759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.603960+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:07:31.603960+0000","last_peered":"2024-03-19T06:07:31.603960+0000","last_clean":"2024-03-19T06:07:31.603960+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:07:31.603960+0000","last_undegraded":"2024-03-19T06:07:31.603960+0000","last_fullsized":"2024-03-19T06:07:31.603960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246888+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:07:02.246888+0000","last_peered":"2024-03-19T06:07:02.246888+0000","last_clean":"2024-03-19T06:07:02.246888+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:07:02.246888+0000","last_undegraded":"2024-03-19T06:07:02.246888+0000","last_fullsized":"2024-03-19T06:07:02.246888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241798+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:07:02.241798+0000","last_peered":"2024-03-19T06:07:02.241798+0000","last_clean":"2024-03-19T06:07:02.241798+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:07:02.241798+0000","last_undegraded":"2024-03-19T06:07:02.241798+0000","last_fullsized":"2024-03-19T06:07:02.241798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.546487+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:07:24.546487+0000","last_peered":"2024-03-19T06:07:24.546487+0000","last_clean":"2024-03-19T06:07:24.546487+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:07:24.546487+0000","last_undegraded":"2024-03-19T06:07:24.546487+0000","last_fullsized":"2024-03-19T06:07:24.546487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002159+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:07:02.002159+0000","last_peered":"2024-03-19T06:07:02.002159+0000","last_clean":"2024-03-19T06:07:02.002159+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:07:02.002159+0000","last_undegraded":"2024-03-19T06:07:02.002159+0000","last_fullsized":"2024-03-19T06:07:02.002159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001301+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:07:02.001301+0000","last_peered":"2024-03-19T06:07:02.001301+0000","last_clean":"2024-03-19T06:07:02.001301+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:07:02.001301+0000","last_undegraded":"2024-03-19T06:07:02.001301+0000","last_fullsized":"2024-03-19T06:07:02.001301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.568774+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:07:24.568774+0000","last_peered":"2024-03-19T06:07:24.568774+0000","last_clean":"2024-03-19T06:07:24.568774+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:07:24.568774+0000","last_undegraded":"2024-03-19T06:07:24.568774+0000","last_fullsized":"2024-03-19T06:07:24.568774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.002617+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:07:02.002617+0000","last_peered":"2024-03-19T06:07:02.002617+0000","last_clean":"2024-03-19T06:07:02.002617+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:07:02.002617+0000","last_undegraded":"2024-03-19T06:07:02.002617+0000","last_fullsized":"2024-03-19T06:07:02.002617+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.044065+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:07:02.044065+0000","last_peered":"2024-03-19T06:07:02.044065+0000","last_clean":"2024-03-19T06:07:02.044065+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:07:02.044065+0000","last_undegraded":"2024-03-19T06:07:02.044065+0000","last_fullsized":"2024-03-19T06:07:02.044065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.560919+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:07:24.560919+0000","last_peered":"2024-03-19T06:07:24.560919+0000","last_clean":"2024-03-19T06:07:24.560919+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:07:24.560919+0000","last_undegraded":"2024-03-19T06:07:24.560919+0000","last_fullsized":"2024-03-19T06:07:24.560919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993250+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:07:01.993250+0000","last_peered":"2024-03-19T06:07:01.993250+0000","last_clean":"2024-03-19T06:07:01.993250+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:07:01.993250+0000","last_undegraded":"2024-03-19T06:07:01.993250+0000","last_fullsized":"2024-03-19T06:07:01.993250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247142+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:07:02.247142+0000","last_peered":"2024-03-19T06:07:02.247142+0000","last_clean":"2024-03-19T06:07:02.247142+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:07:02.247142+0000","last_undegraded":"2024-03-19T06:07:02.247142+0000","last_fullsized":"2024-03-19T06:07:02.247142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.552623+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:07:24.552623+0000","last_peered":"2024-03-19T06:07:24.552623+0000","last_clean":"2024-03-19T06:07:24.552623+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:07:24.552623+0000","last_undegraded":"2024-03-19T06:07:24.552623+0000","last_fullsized":"2024-03-19T06:07:24.552623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.992913+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:07:01.992913+0000","last_peered":"2024-03-19T06:07:01.992913+0000","last_clean":"2024-03-19T06:07:01.992913+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:07:01.992913+0000","last_undegraded":"2024-03-19T06:07:01.992913+0000","last_fullsized":"2024-03-19T06:07:01.992913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042627+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:07:02.042627+0000","last_peered":"2024-03-19T06:07:02.042627+0000","last_clean":"2024-03-19T06:07:02.042627+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:07:02.042627+0000","last_undegraded":"2024-03-19T06:07:02.042627+0000","last_fullsized":"2024-03-19T06:07:02.042627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001706+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:07:02.001706+0000","last_peered":"2024-03-19T06:07:02.001706+0000","last_clean":"2024-03-19T06:07:02.001706+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:07:02.001706+0000","last_undegraded":"2024-03-19T06:07:02.001706+0000","last_fullsized":"2024-03-19T06:07:02.001706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.561506+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:07:24.561506+0000","last_peered":"2024-03-19T06:07:24.561506+0000","last_clean":"2024-03-19T06:07:24.561506+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:07:24.561506+0000","last_undegraded":"2024-03-19T06:07:24.561506+0000","last_fullsized":"2024-03-19T06:07:24.561506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156234+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:07:02.156234+0000","last_peered":"2024-03-19T06:07:02.156234+0000","last_clean":"2024-03-19T06:07:02.156234+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:07:02.156234+0000","last_undegraded":"2024-03-19T06:07:02.156234+0000","last_fullsized":"2024-03-19T06:07:02.156234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993429+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:07:01.993429+0000","last_peered":"2024-03-19T06:07:01.993429+0000","last_clean":"2024-03-19T06:07:01.993429+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:07:01.993429+0000","last_undegraded":"2024-03-19T06:07:01.993429+0000","last_fullsized":"2024-03-19T06:07:01.993429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:31.678777+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:07:31.678777+0000","last_peered":"2024-03-19T06:07:31.678777+0000","last_clean":"2024-03-19T06:07:31.678777+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:07:31.678777+0000","last_undegraded":"2024-03-19T06:07:31.678777+0000","last_fullsized":"2024-03-19T06:07:31.678777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'7","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:34.371422+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:07:34.371422+0000","last_peered":"2024-03-19T06:07:34.371422+0000","last_clean":"2024-03-19T06:07:34.371422+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:07:34.371422+0000","last_undegraded":"2024-03-19T06:07:34.371422+0000","last_fullsized":"2024-03-19T06:07:34.371422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043573+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:07:02.043573+0000","last_peered":"2024-03-19T06:07:02.043573+0000","last_clean":"2024-03-19T06:07:02.043573+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:07:02.043573+0000","last_undegraded":"2024-03-19T06:07:02.043573+0000","last_fullsized":"2024-03-19T06:07:02.043573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000236+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:07:02.000236+0000","last_peered":"2024-03-19T06:07:02.000236+0000","last_clean":"2024-03-19T06:07:02.000236+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:07:02.000236+0000","last_undegraded":"2024-03-19T06:07:02.000236+0000","last_fullsized":"2024-03-19T06:07:02.000236+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'5","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:24.776946+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:07:24.776946+0000","last_peered":"2024-03-19T06:07:24.776946+0000","last_clean":"2024-03-19T06:07:24.776946+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:07:24.776946+0000","last_undegraded":"2024-03-19T06:07:24.776946+0000","last_fullsized":"2024-03-19T06:07:24.776946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000566+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:07:02.000566+0000","last_peered":"2024-03-19T06:07:02.000566+0000","last_clean":"2024-03-19T06:07:02.000566+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:07:02.000566+0000","last_undegraded":"2024-03-19T06:07:02.000566+0000","last_fullsized":"2024-03-19T06:07:02.000566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995704+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:07:01.995704+0000","last_peered":"2024-03-19T06:07:01.995704+0000","last_clean":"2024-03-19T06:07:01.995704+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:07:01.995704+0000","last_undegraded":"2024-03-19T06:07:01.995704+0000","last_fullsized":"2024-03-19T06:07:01.995704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154044+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:07:02.154044+0000","last_peered":"2024-03-19T06:07:02.154044+0000","last_clean":"2024-03-19T06:07:02.154044+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:07:02.154044+0000","last_undegraded":"2024-03-19T06:07:02.154044+0000","last_fullsized":"2024-03-19T06:07:02.154044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.998953+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:07:01.998953+0000","last_peered":"2024-03-19T06:07:01.998953+0000","last_clean":"2024-03-19T06:07:01.998953+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:07:01.998953+0000","last_undegraded":"2024-03-19T06:07:01.998953+0000","last_fullsized":"2024-03-19T06:07:01.998953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005904+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:07:02.005904+0000","last_peered":"2024-03-19T06:07:02.005904+0000","last_clean":"2024-03-19T06:07:02.005904+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:07:02.005904+0000","last_undegraded":"2024-03-19T06:07:02.005904+0000","last_fullsized":"2024-03-19T06:07:02.005904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043348+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:07:02.043348+0000","last_peered":"2024-03-19T06:07:02.043348+0000","last_clean":"2024-03-19T06:07:02.043348+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:07:02.043348+0000","last_undegraded":"2024-03-19T06:07:02.043348+0000","last_fullsized":"2024-03-19T06:07:02.043348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.995602+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:07:01.995602+0000","last_peered":"2024-03-19T06:07:01.995602+0000","last_clean":"2024-03-19T06:07:01.995602+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:07:01.995602+0000","last_undegraded":"2024-03-19T06:07:01.995602+0000","last_fullsized":"2024-03-19T06:07:01.995602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.004568+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:07:02.004568+0000","last_peered":"2024-03-19T06:07:02.004568+0000","last_clean":"2024-03-19T06:07:02.004568+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:07:02.004568+0000","last_undegraded":"2024-03-19T06:07:02.004568+0000","last_fullsized":"2024-03-19T06:07:02.004568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156237+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:07:02.156237+0000","last_peered":"2024-03-19T06:07:02.156237+0000","last_clean":"2024-03-19T06:07:02.156237+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:07:02.156237+0000","last_undegraded":"2024-03-19T06:07:02.156237+0000","last_fullsized":"2024-03-19T06:07:02.156237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.997230+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:07:01.997230+0000","last_peered":"2024-03-19T06:07:01.997230+0000","last_clean":"2024-03-19T06:07:01.997230+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:07:01.997230+0000","last_undegraded":"2024-03-19T06:07:01.997230+0000","last_fullsized":"2024-03-19T06:07:01.997230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244587+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:07:02.244587+0000","last_peered":"2024-03-19T06:07:02.244587+0000","last_clean":"2024-03-19T06:07:02.244587+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:07:02.244587+0000","last_undegraded":"2024-03-19T06:07:02.244587+0000","last_fullsized":"2024-03-19T06:07:02.244587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993231+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:07:01.993231+0000","last_peered":"2024-03-19T06:07:01.993231+0000","last_clean":"2024-03-19T06:07:01.993231+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:07:01.993231+0000","last_undegraded":"2024-03-19T06:07:01.993231+0000","last_fullsized":"2024-03-19T06:07:01.993231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.246075+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:07:02.246075+0000","last_peered":"2024-03-19T06:07:02.246075+0000","last_clean":"2024-03-19T06:07:02.246075+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:07:02.246075+0000","last_undegraded":"2024-03-19T06:07:02.246075+0000","last_fullsized":"2024-03-19T06:07:02.246075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042839+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:07:02.042839+0000","last_peered":"2024-03-19T06:07:02.042839+0000","last_clean":"2024-03-19T06:07:02.042839+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:07:02.042839+0000","last_undegraded":"2024-03-19T06:07:02.042839+0000","last_fullsized":"2024-03-19T06:07:02.042839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.154779+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:07:02.154779+0000","last_peered":"2024-03-19T06:07:02.154779+0000","last_clean":"2024-03-19T06:07:02.154779+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:07:02.154779+0000","last_undegraded":"2024-03-19T06:07:02.154779+0000","last_fullsized":"2024-03-19T06:07:02.154779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242289+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:07:02.242289+0000","last_peered":"2024-03-19T06:07:02.242289+0000","last_clean":"2024-03-19T06:07:02.242289+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:07:02.242289+0000","last_undegraded":"2024-03-19T06:07:02.242289+0000","last_fullsized":"2024-03-19T06:07:02.242289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.000126+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:07:02.000126+0000","last_peered":"2024-03-19T06:07:02.000126+0000","last_clean":"2024-03-19T06:07:02.000126+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:07:02.000126+0000","last_undegraded":"2024-03-19T06:07:02.000126+0000","last_fullsized":"2024-03-19T06:07:02.000126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247072+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:07:02.247072+0000","last_peered":"2024-03-19T06:07:02.247072+0000","last_clean":"2024-03-19T06:07:02.247072+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:07:02.247072+0000","last_undegraded":"2024-03-19T06:07:02.247072+0000","last_fullsized":"2024-03-19T06:07:02.247072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.244557+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:07:02.244557+0000","last_peered":"2024-03-19T06:07:02.244557+0000","last_clean":"2024-03-19T06:07:02.244557+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:07:02.244557+0000","last_undegraded":"2024-03-19T06:07:02.244557+0000","last_fullsized":"2024-03-19T06:07:02.244557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001833+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:07:02.001833+0000","last_peered":"2024-03-19T06:07:02.001833+0000","last_clean":"2024-03-19T06:07:02.001833+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:07:02.001833+0000","last_undegraded":"2024-03-19T06:07:02.001833+0000","last_fullsized":"2024-03-19T06:07:02.001833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.042647+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:07:02.042647+0000","last_peered":"2024-03-19T06:07:02.042647+0000","last_clean":"2024-03-19T06:07:02.042647+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:07:02.042647+0000","last_undegraded":"2024-03-19T06:07:02.042647+0000","last_fullsized":"2024-03-19T06:07:02.042647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.162102+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:07:02.162102+0000","last_peered":"2024-03-19T06:07:02.162102+0000","last_clean":"2024-03-19T06:07:02.162102+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:07:02.162102+0000","last_undegraded":"2024-03-19T06:07:02.162102+0000","last_fullsized":"2024-03-19T06:07:02.162102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.001286+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:07:02.001286+0000","last_peered":"2024-03-19T06:07:02.001286+0000","last_clean":"2024-03-19T06:07:02.001286+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:07:02.001286+0000","last_undegraded":"2024-03-19T06:07:02.001286+0000","last_fullsized":"2024-03-19T06:07:02.001286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.155928+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:07:02.155928+0000","last_peered":"2024-03-19T06:07:02.155928+0000","last_clean":"2024-03-19T06:07:02.155928+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:07:02.155928+0000","last_undegraded":"2024-03-19T06:07:02.155928+0000","last_fullsized":"2024-03-19T06:07:02.155928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.156135+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:07:02.156135+0000","last_peered":"2024-03-19T06:07:02.156135+0000","last_clean":"2024-03-19T06:07:02.156135+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:07:02.156135+0000","last_undegraded":"2024-03-19T06:07:02.156135+0000","last_fullsized":"2024-03-19T06:07:02.156135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.242863+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:07:02.242863+0000","last_peered":"2024-03-19T06:07:02.242863+0000","last_clean":"2024-03-19T06:07:02.242863+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:07:02.242863+0000","last_undegraded":"2024-03-19T06:07:02.242863+0000","last_fullsized":"2024-03-19T06:07:02.242863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:01.993019+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:07:01.993019+0000","last_peered":"2024-03-19T06:07:01.993019+0000","last_clean":"2024-03-19T06:07:01.993019+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:07:01.993019+0000","last_undegraded":"2024-03-19T06:07:01.993019+0000","last_fullsized":"2024-03-19T06:07:01.993019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.240899+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:07:02.240899+0000","last_peered":"2024-03-19T06:07:02.240899+0000","last_clean":"2024-03-19T06:07:02.240899+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:07:02.240899+0000","last_undegraded":"2024-03-19T06:07:02.240899+0000","last_fullsized":"2024-03-19T06:07:02.240899+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.047146+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:07:02.047146+0000","last_peered":"2024-03-19T06:07:02.047146+0000","last_clean":"2024-03-19T06:07:02.047146+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:07:02.047146+0000","last_undegraded":"2024-03-19T06:07:02.047146+0000","last_fullsized":"2024-03-19T06:07:02.047146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.241517+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:07:02.241517+0000","last_peered":"2024-03-19T06:07:02.241517+0000","last_clean":"2024-03-19T06:07:02.241517+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:07:02.241517+0000","last_undegraded":"2024-03-19T06:07:02.241517+0000","last_fullsized":"2024-03-19T06:07:02.241517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.247855+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:07:02.247855+0000","last_peered":"2024-03-19T06:07:02.247855+0000","last_clean":"2024-03-19T06:07:02.247855+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:07:02.247855+0000","last_undegraded":"2024-03-19T06:07:02.247855+0000","last_fullsized":"2024-03-19T06:07:02.247855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.043112+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:07:02.043112+0000","last_peered":"2024-03-19T06:07:02.043112+0000","last_clean":"2024-03-19T06:07:02.043112+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:07:02.043112+0000","last_undegraded":"2024-03-19T06:07:02.043112+0000","last_fullsized":"2024-03-19T06:07:02.043112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.005165+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:07:02.005165+0000","last_peered":"2024-03-19T06:07:02.005165+0000","last_clean":"2024-03-19T06:07:02.005165+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:07:02.005165+0000","last_undegraded":"2024-03-19T06:07:02.005165+0000","last_fullsized":"2024-03-19T06:07:02.005165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:07:02.161673+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:07:02.161673+0000","last_peered":"2024-03-19T06:07:02.161673+0000","last_clean":"2024-03-19T06:07:02.161673+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:07:02.161673+0000","last_undegraded":"2024-03-19T06:07:02.161673+0000","last_fullsized":"2024-03-19T06:07:02.161673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":8858,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":17716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476760,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":958464,"data_stored":733305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476759,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":144327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476758,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":142929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719476758,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":146243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":146231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":143005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":364544,"data_stored":142543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":954368,"data_stored":732661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:07:41.040 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-19T06:07:41.040 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-19T06:07:41.040 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-19T06:07:41.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-19T06:07:41.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.302+0000 7f1540c00640 1 Processor -- start 2024-03-19T06:07:41.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.302+0000 7f1540c00640 1 -- start start 2024-03-19T06:07:41.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.304+0000 7f1540c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f153c153df0 0x7f153c0c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:41.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.304+0000 7f1540c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c1541d0 con 0x7f153c0717c0 2024-03-19T06:07:41.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.304+0000 7f1540c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c159a50 con 0x7f153c0c5c50 2024-03-19T06:07:41.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.304+0000 7f1540c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0c6b80 con 0x7f153c153df0 2024-03-19T06:07:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.305+0000 7f153b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f153c153df0 0x7f153c0c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.305+0000 7f153be00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f153c0717c0 0x7f153c1643b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48444/0 (socket says 172.21.15.17:48444) 2024-03-19T06:07:41.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.305+0000 7f153be00640 1 -- 172.21.15.17:0/4194724325 learned_addr learned my addr 172.21.15.17:0/4194724325 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.311+0000 7f153b400640 1 -- 172.21.15.17:0/4194724325 >> v1:172.21.15.153:6789/0 conn(0x7f153c0c5c50 legacy=0x7f153c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.311+0000 7f153b400640 1 -- 172.21.15.17:0/4194724325 >> v1:172.21.15.17:6789/0 conn(0x7f153c0717c0 legacy=0x7f153c1643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.311+0000 7f153b400640 1 -- 172.21.15.17:0/4194724325 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c0c6e60 con 0x7f153c153df0 2024-03-19T06:07:41.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.315+0000 7f153b400640 1 --2- 172.21.15.17:0/4194724325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c153df0 0x7f153c0c53d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f152c0097a0 tx=0x7f152c02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807f657ad5c35442 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:41.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.321+0000 7f153a000640 1 -- 172.21.15.17:0/4194724325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c02f810 con 0x7f153c153df0 2024-03-19T06:07:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.321+0000 7f153a000640 1 -- 172.21.15.17:0/4194724325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152c02f9b0 con 0x7f153c153df0 2024-03-19T06:07:41.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.321+0000 7f153a000640 1 -- 172.21.15.17:0/4194724325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152c02fd80 con 0x7f153c153df0 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 -- 172.21.15.17:0/4194724325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c153df0 msgr2=0x7f153c0c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 --2- 172.21.15.17:0/4194724325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c153df0 0x7f153c0c53d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f152c0097a0 tx=0x7f152c02b9f0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 -- 172.21.15.17:0/4194724325 shutdown_connections 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 --2- 172.21.15.17:0/4194724325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c153df0 0x7f153c0c53d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 -- 172.21.15.17:0/4194724325 >> 172.21.15.17:0/4194724325 conn(0x7f153c06e630 msgr2=0x7f153c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 -- 172.21.15.17:0/4194724325 shutdown_connections 2024-03-19T06:07:41.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.323+0000 7f1540c00640 1 -- 172.21.15.17:0/4194724325 wait complete. 2024-03-19T06:07:41.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.327+0000 7f1540c00640 1 Processor -- start 2024-03-19T06:07:41.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.327+0000 7f1540c00640 1 -- start start 2024-03-19T06:07:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c0717c0 0x7f153c1f3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:41.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f153c153df0 0x7f153c152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c159ff0 con 0x7f153c0717c0 2024-03-19T06:07:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c159d10 con 0x7f153c0c5c50 2024-03-19T06:07:41.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.329+0000 7f1540c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c0c65d0 con 0x7f153c153df0 2024-03-19T06:07:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.330+0000 7f153aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:41.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.331+0000 7f153be00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f153c153df0 0x7f153c152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.331+0000 7f153aa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41874/0 (socket says 172.21.15.17:41874) 2024-03-19T06:07:41.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.331+0000 7f153aa00640 1 -- 172.21.15.17:0/2289487505 learned_addr learned my addr 172.21.15.17:0/2289487505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:41.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.345+0000 7f153aa00640 1 -- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f153c153df0 msgr2=0x7f153c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.345+0000 7f153aa00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f153c153df0 0x7f153c152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.346+0000 7f153aa00640 1 -- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c0717c0 msgr2=0x7f153c1f3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:41.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.346+0000 7f153aa00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c0717c0 0x7f153c1f3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:41.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.346+0000 7f153aa00640 1 -- 172.21.15.17:0/2289487505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c14f200 con 0x7f153c0c5c50 2024-03-19T06:07:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.354+0000 7f153aa00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f152400c7d0 tx=0x7f152400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:41.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.365+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524016020 con 0x7f153c0c5c50 2024-03-19T06:07:41.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.365+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524006d50 con 0x7f153c0c5c50 2024-03-19T06:07:41.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.365+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524003bb0 con 0x7f153c0c5c50 2024-03-19T06:07:41.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.365+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c14f4e0 con 0x7f153c0c5c50 2024-03-19T06:07:41.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.366+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c1efea0 con 0x7f153c0c5c50 2024-03-19T06:07:41.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.367+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c0686e0 con 0x7f153c0c5c50 2024-03-19T06:07:41.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.717+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f152400a850 con 0x7f153c0c5c50 2024-03-19T06:07:41.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.719+0000 7f1533400640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 0x7f151806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:41.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.720+0000 7f153b400640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 0x7f151806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:41.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.722+0000 7f153b400640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 0x7f151806e0e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f152c036000 tx=0x7f152c039040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:41.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.724+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1524057940 con 0x7f153c0c5c50 2024-03-19T06:07:41.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:41.761+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f1524020020 con 0x7f153c0c5c50 2024-03-19T06:07:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.018+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f153c1ef9b0 con 0x7f153c0c5c50 2024-03-19T06:07:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.046+0000 7f1533400640 1 -- 172.21.15.17:0/2289487505 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1524059fa0 con 0x7f153c0c5c50 2024-03-19T06:07:42.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:42.037 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-19T06:07:42.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 msgr2=0x7f151806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 0x7f151806e0e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f152c036000 tx=0x7f152c039040 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 msgr2=0x7f153c0ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f152400c7d0 tx=0x7f152400cc90 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 shutdown_connections 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f153c153df0 0x7f153c152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f151806bc20 0x7f151806e0e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f153c0c5c50 0x7f153c0ca690 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 --2- 172.21.15.17:0/2289487505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f153c0717c0 0x7f153c1f3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 >> 172.21.15.17:0/2289487505 conn(0x7f153c06e630 msgr2=0x7f153c0c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:42.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 shutdown_connections 2024-03-19T06:07:42.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.049+0000 7f1540c00640 1 -- 172.21.15.17:0/2289487505 wait complete. 2024-03-19T06:07:42.063 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-19T06:07:42.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.289+0000 7fec6f200640 1 Processor -- start 2024-03-19T06:07:42.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.289+0000 7fec6f200640 1 -- start start 2024-03-19T06:07:42.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.291+0000 7fec6f200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec70159c10 0x7fec7015b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.291+0000 7fec6f200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec7015dc60 0x7fec700caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.291+0000 7fec6f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7015a200 con 0x7fec700c9410 2024-03-19T06:07:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.291+0000 7fec6f200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7015e0d0 con 0x7fec70159c10 2024-03-19T06:07:42.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.291+0000 7fec6f200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec700caac0 con 0x7fec7015dc60 2024-03-19T06:07:42.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.293+0000 7fec6e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec7015dc60 0x7fec700caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.294+0000 7fec6e800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fec7015dc60 0x7fec700caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41882/0 (socket says 172.21.15.17:41882) 2024-03-19T06:07:42.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.294+0000 7fec6e800640 1 -- 172.21.15.17:0/1706135553 learned_addr learned my addr 172.21.15.17:0/1706135553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.300+0000 7fec6e800640 1 -- 172.21.15.17:0/1706135553 >> v2:172.21.15.17:3300/0 conn(0x7fec70159c10 msgr2=0x7fec7015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.300+0000 7fec6e800640 1 --2- 172.21.15.17:0/1706135553 >> v2:172.21.15.17:3300/0 conn(0x7fec70159c10 0x7fec7015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.300+0000 7fec6e800640 1 -- 172.21.15.17:0/1706135553 >> v1:172.21.15.17:6789/0 conn(0x7fec700c9410 legacy=0x7fec700ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:42.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.300+0000 7fec6e800640 1 -- 172.21.15.17:0/1706135553 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7015a4c0 con 0x7fec7015dc60 2024-03-19T06:07:42.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.305+0000 7fec6e800640 1 --2- 172.21.15.17:0/1706135553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec700caea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec700cf330 tx=0x7fec6802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c464dc80e200d895 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.316+0000 7fec6ca00640 1 -- 172.21.15.17:0/1706135553 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6802ca80 con 0x7fec7015dc60 2024-03-19T06:07:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.316+0000 7fec6ca00640 1 -- 172.21.15.17:0/1706135553 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6802cc20 con 0x7fec7015dc60 2024-03-19T06:07:42.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.316+0000 7fec6ca00640 1 -- 172.21.15.17:0/1706135553 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680343f0 con 0x7fec7015dc60 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 -- 172.21.15.17:0/1706135553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 msgr2=0x7fec700caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 --2- 172.21.15.17:0/1706135553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec700caea0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec700cf330 tx=0x7fec6802bee0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 -- 172.21.15.17:0/1706135553 shutdown_connections 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 --2- 172.21.15.17:0/1706135553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec700caea0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 --2- 172.21.15.17:0/1706135553 >> v2:172.21.15.17:3300/0 conn(0x7fec70159c10 0x7fec7015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.317+0000 7fec6f200640 1 -- 172.21.15.17:0/1706135553 >> 172.21.15.17:0/1706135553 conn(0x7fec70072360 msgr2=0x7fec70072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.318+0000 7fec6f200640 1 -- 172.21.15.17:0/1706135553 shutdown_connections 2024-03-19T06:07:42.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.318+0000 7fec6f200640 1 -- 172.21.15.17:0/1706135553 wait complete. 2024-03-19T06:07:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.320+0000 7fec6f200640 1 Processor -- start 2024-03-19T06:07:42.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.320+0000 7fec6f200640 1 -- start start 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec700c9410 0x7fec70153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec70159c10 0x7fec70151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7015d180 con 0x7fec700c9410 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7015aa80 con 0x7fec7015dc60 2024-03-19T06:07:42.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.321+0000 7fec6f200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7015d460 con 0x7fec70159c10 2024-03-19T06:07:42.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.323+0000 7fec6e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:42.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.323+0000 7fec6d400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec70159c10 0x7fec70151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:42.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.324+0000 7fec6e800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:41896/0 (socket says 172.21.15.17:41896) 2024-03-19T06:07:42.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.324+0000 7fec6e800640 1 -- 172.21.15.17:0/4077827400 learned_addr learned my addr 172.21.15.17:0/4077827400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:42.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.330+0000 7fec6de00640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec700c9410 0x7fec70153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:42.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.335+0000 7fec6e800640 1 -- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec70159c10 msgr2=0x7fec70151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:42.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.335+0000 7fec6e800640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec70159c10 0x7fec70151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.335+0000 7fec6e800640 1 -- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec700c9410 msgr2=0x7fec70153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.335+0000 7fec6e800640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec700c9410 0x7fec70153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:42.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.335+0000 7fec6e800640 1 -- 172.21.15.17:0/4077827400 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700c8730 con 0x7fec7015dc60 2024-03-19T06:07:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.353+0000 7fec6e800640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec68036040 tx=0x7fec68004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.461+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68043020 con 0x7fec7015dc60 2024-03-19T06:07:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.461+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6803e450 con 0x7fec7015dc60 2024-03-19T06:07:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.461+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68009510 con 0x7fec7015dc60 2024-03-19T06:07:42.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.461+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec700cf330 con 0x7fec7015dc60 2024-03-19T06:07:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.461+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec700cf8f0 con 0x7fec7015dc60 2024-03-19T06:07:42.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.463+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec700b4b60 con 0x7fec7015dc60 2024-03-19T06:07:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.790+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fec68046020 con 0x7fec7015dc60 2024-03-19T06:07:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.793+0000 7fec66000640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 0x7fec5006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.794+0000 7fec6de00640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 0x7fec5006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:42.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.795+0000 7fec6de00640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 0x7fec5006e110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec600017f0 tx=0x7fec60009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:42.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.799+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fec68079c30 con 0x7fec7015dc60 2024-03-19T06:07:42.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:42.833+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fec700b4b60 con 0x7fec7015dc60 2024-03-19T06:07:43.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.058+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec7004f050 con 0x7fec7015dc60 2024-03-19T06:07:43.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.156+0000 7fec66000640 1 -- 172.21.15.17:0/4077827400 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7fec6804d070 con 0x7fec7015dc60 2024-03-19T06:07:43.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:43.148 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:43.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 msgr2=0x7fec5006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 0x7fec5006e110 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec600017f0 tx=0x7fec60009040 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 msgr2=0x7fec70150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fec68036040 tx=0x7fec68004a40 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 shutdown_connections 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fec5006bc50 0x7fec5006e110 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec7015dc60 0x7fec70150b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fec70159c10 0x7fec70151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 --2- 172.21.15.17:0/4077827400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec700c9410 0x7fec70153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.160+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 >> 172.21.15.17:0/4077827400 conn(0x7fec70072360 msgr2=0x7fec70072740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.161+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 shutdown_connections 2024-03-19T06:07:43.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.161+0000 7fec6f200640 1 -- 172.21.15.17:0/4077827400 wait complete. 2024-03-19T06:07:43.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:07:43.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:07:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.407+0000 7fd869600640 1 Processor -- start 2024-03-19T06:07:43.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.407+0000 7fd869600640 1 -- start start 2024-03-19T06:07:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.408+0000 7fd869600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 0x7fd864169b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.409+0000 7fd869600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8640c6b70 con 0x7fd8640c7570 2024-03-19T06:07:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.409+0000 7fd869600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd864162660 con 0x7fd8641586a0 2024-03-19T06:07:43.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.409+0000 7fd869600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864073170 con 0x7fd86415ec20 2024-03-19T06:07:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.409+0000 7fd862000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd8640c7570 0x7fd86406e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48460/0 (socket says 172.21.15.17:48460) 2024-03-19T06:07:43.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.409+0000 7fd862000640 1 -- 172.21.15.17:0/1958583435 learned_addr learned my addr 172.21.15.17:0/1958583435 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:43.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.411+0000 7fd863400640 1 --2- 172.21.15.17:0/1958583435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 0x7fd864169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.413+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457402801 0 0) 0x7fd8640c6b70 con 0x7fd8640c7570 2024-03-19T06:07:43.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.414+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd848003520 con 0x7fd8640c7570 2024-03-19T06:07:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.416+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684400582 0 0) 0x7fd864162660 con 0x7fd8641586a0 2024-03-19T06:07:43.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.416+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8640c6b70 con 0x7fd8641586a0 2024-03-19T06:07:43.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.418+0000 7fd863400640 1 -- 172.21.15.17:0/1958583435 >> v1:172.21.15.153:6789/0 conn(0x7fd8641586a0 legacy=0x7fd864070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.418+0000 7fd863400640 1 -- 172.21.15.17:0/1958583435 >> v1:172.21.15.17:6789/0 conn(0x7fd8640c7570 legacy=0x7fd86406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.419+0000 7fd863400640 1 -- 172.21.15.17:0/1958583435 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86415f0b0 con 0x7fd86415ec20 2024-03-19T06:07:43.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.424+0000 7fd863400640 1 --2- 172.21.15.17:0/1958583435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 0x7fd864169b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009dc0 tx=0x7fd85c02bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72476fc216d8518b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.436+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c039070 con 0x7fd86415ec20 2024-03-19T06:07:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.437+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c02cd50 con 0x7fd86415ec20 2024-03-19T06:07:43.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.437+0000 7fd861600640 1 -- 172.21.15.17:0/1958583435 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c034660 con 0x7fd86415ec20 2024-03-19T06:07:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 -- 172.21.15.17:0/1958583435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 msgr2=0x7fd864169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 --2- 172.21.15.17:0/1958583435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 0x7fd864169b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009dc0 tx=0x7fd85c02bfa0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 -- 172.21.15.17:0/1958583435 shutdown_connections 2024-03-19T06:07:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 --2- 172.21.15.17:0/1958583435 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd86415ec20 0x7fd864169b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 -- 172.21.15.17:0/1958583435 >> 172.21.15.17:0/1958583435 conn(0x7fd8640c8910 msgr2=0x7fd8640cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 -- 172.21.15.17:0/1958583435 shutdown_connections 2024-03-19T06:07:43.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.438+0000 7fd869600640 1 -- 172.21.15.17:0/1958583435 wait complete. 2024-03-19T06:07:43.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.441+0000 7fd869600640 1 Processor -- start 2024-03-19T06:07:43.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.441+0000 7fd869600640 1 -- start start 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8640c7570 0x7fd864160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8641586a0 0x7fd8641f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864161b80 con 0x7fd86415ec20 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8641618a0 con 0x7fd8640c7570 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.442+0000 7fd869600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd864161e60 con 0x7fd8641586a0 2024-03-19T06:07:43.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.443+0000 7fd863400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.443+0000 7fd863400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59724/0 (socket says 172.21.15.17:59724) 2024-03-19T06:07:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.443+0000 7fd863400640 1 -- 172.21.15.17:0/4113285866 learned_addr learned my addr 172.21.15.17:0/4113285866 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:43.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.444+0000 7fd862a00640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8640c7570 0x7fd864160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:43.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.446+0000 7fd862000640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8641586a0 0x7fd8641f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.448+0000 7fd863400640 1 -- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8641586a0 msgr2=0x7fd8641f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.448+0000 7fd863400640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8641586a0 0x7fd8641f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.448+0000 7fd863400640 1 -- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8640c7570 msgr2=0x7fd864160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.448+0000 7fd863400640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8640c7570 0x7fd864160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.448+0000 7fd863400640 1 -- 172.21.15.17:0/4113285866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86415e390 con 0x7fd86415ec20 2024-03-19T06:07:43.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.452+0000 7fd863400640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009ee0 tx=0x7fd85c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.459+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c039050 con 0x7fd86415ec20 2024-03-19T06:07:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.459+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c045070 con 0x7fd86415ec20 2024-03-19T06:07:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.459+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c03e850 con 0x7fd86415ec20 2024-03-19T06:07:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.459+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86415de30 con 0x7fd86415ec20 2024-03-19T06:07:43.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.459+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8640caf40 con 0x7fd86415ec20 2024-03-19T06:07:43.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.461+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8640677c0 con 0x7fd86415ec20 2024-03-19T06:07:43.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.751+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd85c03e9f0 con 0x7fd86415ec20 2024-03-19T06:07:43.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.753+0000 7fd85aa00640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 0x7fd84406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:43.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.754+0000 7fd862a00640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 0x7fd84406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:43.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.755+0000 7fd862a00640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 0x7fd84406e0e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd854007fd0 tx=0x7fd854009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:43.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.767+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd85c07a490 con 0x7fd86415ec20 2024-03-19T06:07:43.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.768+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fd8640677c0 con 0x7fd86415ec20 2024-03-19T06:07:43.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:43.982+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd864069be0 con 0x7fd86415ec20 2024-03-19T06:07:43.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.000+0000 7fd85aa00640 1 -- 172.21.15.17:0/4113285866 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd86415de30 con 0x7fd86415ec20 2024-03-19T06:07:43.991 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:07:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 msgr2=0x7fd84406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 0x7fd84406e0e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd854007fd0 tx=0x7fd854009040 comp rx=0 tx=0).stop 2024-03-19T06:07:43.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 msgr2=0x7fd8641f80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009ee0 tx=0x7fd85c004a40 comp rx=0 tx=0).stop 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 shutdown_connections 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd86415ec20 0x7fd8641f80b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd8641586a0 0x7fd8641f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd84406bc20 0x7fd84406e0e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 --2- 172.21.15.17:0/4113285866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8640c7570 0x7fd864160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.003+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 >> 172.21.15.17:0/4113285866 conn(0x7fd8640c8910 msgr2=0x7fd86406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.004+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 shutdown_connections 2024-03-19T06:07:43.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.004+0000 7fd869600640 1 -- 172.21.15.17:0/4113285866 wait complete. 2024-03-19T06:07:44.015 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:07:44.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.246+0000 7f34e0e00640 1 Processor -- start 2024-03-19T06:07:44.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.246+0000 7f34e0e00640 1 -- start start 2024-03-19T06:07:44.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.247+0000 7f34e0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 0x7f34dc0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:44.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.247+0000 7f34e0e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc06bbd0 con 0x7f34dc15a660 2024-03-19T06:07:44.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.247+0000 7f34e0e00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc06beb0 con 0x7f34dc15aa40 2024-03-19T06:07:44.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.247+0000 7f34e0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc06c190 con 0x7f34dc0b2700 2024-03-19T06:07:44.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.248+0000 7f34db400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f34dc15a660 0x7f34dc0b1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48470/0 (socket says 172.21.15.17:48470) 2024-03-19T06:07:44.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.248+0000 7f34db400640 1 -- 172.21.15.17:0/1398073262 learned_addr learned my addr 172.21.15.17:0/1398073262 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:44.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.250+0000 7f34dbe00640 1 --2- 172.21.15.17:0/1398073262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 0x7f34dc0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:44.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.252+0000 7f34daa00640 1 -- 172.21.15.17:0/1398073262 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344081286 0 0) 0x7f34dc06bbd0 con 0x7f34dc15a660 2024-03-19T06:07:44.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.252+0000 7f34daa00640 1 -- 172.21.15.17:0/1398073262 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c0003520 con 0x7f34dc15a660 2024-03-19T06:07:44.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.257+0000 7f34dbe00640 1 -- 172.21.15.17:0/1398073262 >> v1:172.21.15.153:6789/0 conn(0x7f34dc15aa40 legacy=0x7f34dc0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:44.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.257+0000 7f34dbe00640 1 -- 172.21.15.17:0/1398073262 >> v1:172.21.15.17:6789/0 conn(0x7f34dc15a660 legacy=0x7f34dc0b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:44.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.257+0000 7f34dbe00640 1 -- 172.21.15.17:0/1398073262 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc06c470 con 0x7f34dc0b2700 2024-03-19T06:07:44.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.262+0000 7f34dbe00640 1 --2- 172.21.15.17:0/1398073262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 0x7f34dc0b3540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009dc0 tx=0x7f34d402be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9339c0619c25e33e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.276+0000 7f34daa00640 1 -- 172.21.15.17:0/1398073262 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4039070 con 0x7f34dc0b2700 2024-03-19T06:07:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.276+0000 7f34daa00640 1 -- 172.21.15.17:0/1398073262 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d402cc30 con 0x7f34dc0b2700 2024-03-19T06:07:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.276+0000 7f34daa00640 1 -- 172.21.15.17:0/1398073262 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4034440 con 0x7f34dc0b2700 2024-03-19T06:07:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.277+0000 7f34e0e00640 1 -- 172.21.15.17:0/1398073262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 msgr2=0x7f34dc0b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.277+0000 7f34e0e00640 1 --2- 172.21.15.17:0/1398073262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 0x7f34dc0b3540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34d4009dc0 tx=0x7f34d402be80 comp rx=0 tx=0).stop 2024-03-19T06:07:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.277+0000 7f34e0e00640 1 -- 172.21.15.17:0/1398073262 shutdown_connections 2024-03-19T06:07:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.277+0000 7f34e0e00640 1 --2- 172.21.15.17:0/1398073262 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc0b2700 0x7f34dc0b3540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:44.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.277+0000 7f34e0e00640 1 -- 172.21.15.17:0/1398073262 >> 172.21.15.17:0/1398073262 conn(0x7f34dc072360 msgr2=0x7f34dc072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.278+0000 7f34e0e00640 1 -- 172.21.15.17:0/1398073262 shutdown_connections 2024-03-19T06:07:44.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.278+0000 7f34e0e00640 1 -- 172.21.15.17:0/1398073262 wait complete. 2024-03-19T06:07:44.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.281+0000 7f34e0e00640 1 Processor -- start 2024-03-19T06:07:44.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.281+0000 7f34e0e00640 1 -- start start 2024-03-19T06:07:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34dc0b2700 0x7f34dc14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:44.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc15aa40 0x7f34dc150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc06b860 con 0x7f34dc15a660 2024-03-19T06:07:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0b3020 con 0x7f34dc0b2700 2024-03-19T06:07:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.283+0000 7f34e0e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc0ca930 con 0x7f34dc15aa40 2024-03-19T06:07:44.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.284+0000 7f34d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:44.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.284+0000 7f34d3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59726/0 (socket says 172.21.15.17:59726) 2024-03-19T06:07:44.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.284+0000 7f34d3e00640 1 -- 172.21.15.17:0/2784285242 learned_addr learned my addr 172.21.15.17:0/2784285242 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:44.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.285+0000 7f34db400640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34dc0b2700 0x7f34dc14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:44.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.288+0000 7f34dbe00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc15aa40 0x7f34dc150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:44.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.289+0000 7f34d3e00640 1 -- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc15aa40 msgr2=0x7f34dc150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:44.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.289+0000 7f34d3e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc15aa40 0x7f34dc150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:44.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.289+0000 7f34d3e00640 1 -- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34dc0b2700 msgr2=0x7f34dc14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:44.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.289+0000 7f34d3e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34dc0b2700 0x7f34dc14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:44.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.289+0000 7f34d3e00640 1 -- 172.21.15.17:0/2784285242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc14ea20 con 0x7f34dc15a660 2024-03-19T06:07:44.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.292+0000 7f34d3e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34c400c440 tx=0x7f34c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.300+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c40052d0 con 0x7f34dc15a660 2024-03-19T06:07:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.300+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c4005470 con 0x7f34dc15a660 2024-03-19T06:07:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.300+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc15d500 con 0x7f34dc15a660 2024-03-19T06:07:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.300+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c4007260 con 0x7f34dc15a660 2024-03-19T06:07:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.300+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc15daa0 con 0x7f34dc15a660 2024-03-19T06:07:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.301+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc06cc30 con 0x7f34dc15a660 2024-03-19T06:07:44.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.763+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f34c4007400 con 0x7f34dc15a660 2024-03-19T06:07:44.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.765+0000 7f34d3400640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 0x7f34b806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:44.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.766+0000 7f34db400640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 0x7f34b806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:44.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.767+0000 7f34db400640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 0x7f34b806e110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005880 tx=0x7f34cc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:44.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.794+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f34c4056c50 con 0x7f34dc15a660 2024-03-19T06:07:44.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:44.795+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f34dc06cc30 con 0x7f34dc15a660 2024-03-19T06:07:45.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.024+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34dc04f050 con 0x7f34dc15a660 2024-03-19T06:07:45.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.083+0000 7f34d3400640 1 -- 172.21.15.17:0/2784285242 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34c4058bb0 con 0x7f34dc15a660 2024-03-19T06:07:45.074 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 msgr2=0x7f34b806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 0x7f34b806e110 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f34cc005880 tx=0x7f34cc009040 comp rx=0 tx=0).stop 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 msgr2=0x7f34dc15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f34c400c440 tx=0x7f34c4001e70 comp rx=0 tx=0).stop 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 shutdown_connections 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f34dc15aa40 0x7f34dc150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34dc15a660 0x7f34dc15b0e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f34b806bc50 0x7f34b806e110 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 --2- 172.21.15.17:0/2784285242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34dc0b2700 0x7f34dc14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.086+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 >> 172.21.15.17:0/2784285242 conn(0x7f34dc072360 msgr2=0x7f34dc0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:45.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.087+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 shutdown_connections 2024-03-19T06:07:45.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.087+0000 7f34e0e00640 1 -- 172.21.15.17:0/2784285242 wait complete. 2024-03-19T06:07:45.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:07:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.333+0000 7f40cca00640 1 Processor -- start 2024-03-19T06:07:45.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.333+0000 7f40cca00640 1 -- start start 2024-03-19T06:07:45.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.335+0000 7f40cca00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40c8153ee0 0x7f40c80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.335+0000 7f40cca00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f40c806b050 0x7f40c81643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.335+0000 7f40cca00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c8072920 con 0x7f40c806ac30 2024-03-19T06:07:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.335+0000 7f40cca00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80c66b0 con 0x7f40c806b050 2024-03-19T06:07:45.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.335+0000 7f40cca00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80c6990 con 0x7f40c8153ee0 2024-03-19T06:07:45.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.338+0000 7f40c5e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f40c806ac30 0x7f40c815d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:43606/0 (socket says 172.21.15.17:43606) 2024-03-19T06:07:45.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.338+0000 7f40c5e00640 1 -- 172.21.15.17:0/1231526040 learned_addr learned my addr 172.21.15.17:0/1231526040 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:45.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.339+0000 7f40c6800640 1 --2- 172.21.15.17:0/1231526040 >> v2:172.21.15.153:3300/0 conn(0x7f40c8153ee0 0x7f40c80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.352+0000 7f40c6800640 1 -- 172.21.15.17:0/1231526040 >> v2:172.21.15.17:3300/0 conn(0x7f40c806b050 msgr2=0x7f40c81643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.352+0000 7f40c6800640 1 --2- 172.21.15.17:0/1231526040 >> v2:172.21.15.17:3300/0 conn(0x7f40c806b050 0x7f40c81643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.352+0000 7f40c6800640 1 -- 172.21.15.17:0/1231526040 >> v1:172.21.15.153:6789/0 conn(0x7f40c806ac30 legacy=0x7f40c815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.352+0000 7f40c6800640 1 -- 172.21.15.17:0/1231526040 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8071b60 con 0x7f40c8153ee0 2024-03-19T06:07:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.360+0000 7f40c6800640 1 --2- 172.21.15.17:0/1231526040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8153ee0 0x7f40c80c7990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40c8070f20 tx=0x7f40b802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1138bd710382390 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.373+0000 7f40c5400640 1 -- 172.21.15.17:0/1231526040 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8039070 con 0x7f40c8153ee0 2024-03-19T06:07:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.373+0000 7f40c5400640 1 -- 172.21.15.17:0/1231526040 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b802cd00 con 0x7f40c8153ee0 2024-03-19T06:07:45.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.373+0000 7f40c5400640 1 -- 172.21.15.17:0/1231526040 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8034660 con 0x7f40c8153ee0 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 -- 172.21.15.17:0/1231526040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8153ee0 msgr2=0x7f40c80c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 --2- 172.21.15.17:0/1231526040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8153ee0 0x7f40c80c7990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f40c8070f20 tx=0x7f40b802bf50 comp rx=0 tx=0).stop 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 -- 172.21.15.17:0/1231526040 shutdown_connections 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 --2- 172.21.15.17:0/1231526040 >> v2:172.21.15.17:3300/0 conn(0x7f40c806b050 0x7f40c81643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 --2- 172.21.15.17:0/1231526040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8153ee0 0x7f40c80c7990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 -- 172.21.15.17:0/1231526040 >> 172.21.15.17:0/1231526040 conn(0x7f40c80c8390 msgr2=0x7f40c80c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 -- 172.21.15.17:0/1231526040 shutdown_connections 2024-03-19T06:07:45.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.374+0000 7f40cca00640 1 -- 172.21.15.17:0/1231526040 wait complete. 2024-03-19T06:07:45.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.377+0000 7f40cca00640 1 Processor -- start 2024-03-19T06:07:45.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.377+0000 7f40cca00640 1 -- start start 2024-03-19T06:07:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c806ac30 0x7f40c81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c806b050 0x7f40c81501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8072400 con 0x7f40c8153ee0 2024-03-19T06:07:45.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8072120 con 0x7f40c806b050 2024-03-19T06:07:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.379+0000 7f40cca00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c815dca0 con 0x7f40c806ac30 2024-03-19T06:07:45.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.380+0000 7f40c7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.380+0000 7f40c7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59740/0 (socket says 172.21.15.17:59740) 2024-03-19T06:07:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.380+0000 7f40c7200640 1 -- 172.21.15.17:0/583061143 learned_addr learned my addr 172.21.15.17:0/583061143 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.380+0000 7f40c5e00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c806b050 0x7f40c81501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:45.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.381+0000 7f40c6800640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c806ac30 0x7f40c81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:45.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.386+0000 7f40c7200640 1 -- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c806ac30 msgr2=0x7f40c81f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.386+0000 7f40c7200640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c806ac30 0x7f40c81f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.386+0000 7f40c7200640 1 -- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c806b050 msgr2=0x7f40c81501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.386+0000 7f40c7200640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c806b050 0x7f40c81501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:45.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.386+0000 7f40c7200640 1 -- 172.21.15.17:0/583061143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c81f0840 con 0x7f40c8153ee0 2024-03-19T06:07:45.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.390+0000 7f40c7200640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b450 tx=0x7f40c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.396+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0015020 con 0x7f40c8153ee0 2024-03-19T06:07:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.396+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c0011890 con 0x7f40c8153ee0 2024-03-19T06:07:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.396+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0011c60 con 0x7f40c8153ee0 2024-03-19T06:07:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.396+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c8151150 con 0x7f40c8153ee0 2024-03-19T06:07:45.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.396+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c814da80 con 0x7f40c8153ee0 2024-03-19T06:07:45.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.398+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c80c6290 con 0x7f40c8153ee0 2024-03-19T06:07:45.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.730+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f40c0018020 con 0x7f40c8153ee0 2024-03-19T06:07:45.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.733+0000 7f40bea00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:45.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.733+0000 7f40c6800640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:45.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.735+0000 7f40c6800640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40b8036000 tx=0x7f40b8030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.761+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f40c0011e00 con 0x7f40c8153ee0 2024-03-19T06:07:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:45.762+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f40c80c6290 con 0x7f40c8153ee0 2024-03-19T06:07:46.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.011+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40c80c5cd0 con 0x7f40c8153ee0 2024-03-19T06:07:46.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.021+0000 7f40bea00640 1 -- 172.21.15.17:0/583061143 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40c001f020 con 0x7f40c8153ee0 2024-03-19T06:07:46.011 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.023+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 msgr2=0x7f40a406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.023+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f40b8036000 tx=0x7f40b8030000 comp rx=0 tx=0).stop 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.023+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 msgr2=0x7f40c80c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.023+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b450 tx=0x7f40c000b910 comp rx=0 tx=0).stop 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.023+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 shutdown_connections 2024-03-19T06:07:46.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c8153ee0 0x7f40c80c3d20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f40a406bc20 0x7f40a406e0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c806b050 0x7f40c81501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 --2- 172.21.15.17:0/583061143 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f40c806ac30 0x7f40c81f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 >> 172.21.15.17:0/583061143 conn(0x7f40c80c8390 msgr2=0x7f40c8152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 shutdown_connections 2024-03-19T06:07:46.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.024+0000 7f40cca00640 1 -- 172.21.15.17:0/583061143 wait complete. 2024-03-19T06:07:46.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:07:46.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.268+0000 7f37ba000640 1 Processor -- start 2024-03-19T06:07:46.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.268+0000 7f37ba000640 1 -- start start 2024-03-19T06:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.269+0000 7f37ba000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f37b406e7c0 0x7f37b40cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.270+0000 7f37ba000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 0x7f37b4159b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.270+0000 7f37ba000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b40cb1e0 con 0x7f37b40c8910 2024-03-19T06:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.270+0000 7f37ba000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b40cb7f0 con 0x7f37b406e7c0 2024-03-19T06:07:46.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.270+0000 7f37ba000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c5d80 con 0x7f37b406eba0 2024-03-19T06:07:46.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.271+0000 7f37b9600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f37b40c8910 0x7f37b4153980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48486/0 (socket says 172.21.15.17:48486) 2024-03-19T06:07:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.271+0000 7f37b9600640 1 -- 172.21.15.17:0/2713588325 learned_addr learned my addr 172.21.15.17:0/2713588325 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.272+0000 7f37b8c00640 1 --2- 172.21.15.17:0/2713588325 >> v2:172.21.15.17:3300/0 conn(0x7f37b406e7c0 0x7f37b40cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.272+0000 7f37abe00640 1 --2- 172.21.15.17:0/2713588325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 0x7f37b4159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.277+0000 7f37b3e00640 1 -- 172.21.15.17:0/2713588325 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079240752 0 0) 0x7f37b40cb1e0 con 0x7f37b40c8910 2024-03-19T06:07:46.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.277+0000 7f37b3e00640 1 -- 172.21.15.17:0/2713588325 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3798003520 con 0x7f37b40c8910 2024-03-19T06:07:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.279+0000 7f37abe00640 1 -- 172.21.15.17:0/2713588325 >> v2:172.21.15.17:3300/0 conn(0x7f37b406e7c0 msgr2=0x7f37b40cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.279+0000 7f37abe00640 1 --2- 172.21.15.17:0/2713588325 >> v2:172.21.15.17:3300/0 conn(0x7f37b406e7c0 0x7f37b40cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.279+0000 7f37abe00640 1 -- 172.21.15.17:0/2713588325 >> v1:172.21.15.17:6789/0 conn(0x7f37b40c8910 legacy=0x7f37b4153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.279+0000 7f37abe00640 1 -- 172.21.15.17:0/2713588325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b40c6060 con 0x7f37b406eba0 2024-03-19T06:07:46.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.284+0000 7f37abe00640 1 --2- 172.21.15.17:0/2713588325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 0x7f37b4159b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f379c0097a0 tx=0x7f379c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3afa8fbb44346e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:46.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.294+0000 7f37b3e00640 1 -- 172.21.15.17:0/2713588325 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c035020 con 0x7f37b406eba0 2024-03-19T06:07:46.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.294+0000 7f37b3e00640 1 -- 172.21.15.17:0/2713588325 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c031810 con 0x7f37b406eba0 2024-03-19T06:07:46.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.294+0000 7f37b3e00640 1 -- 172.21.15.17:0/2713588325 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c031be0 con 0x7f37b406eba0 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 -- 172.21.15.17:0/2713588325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 msgr2=0x7f37b4159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 --2- 172.21.15.17:0/2713588325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 0x7f37b4159b00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f379c0097a0 tx=0x7f379c02b8b0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 -- 172.21.15.17:0/2713588325 shutdown_connections 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 --2- 172.21.15.17:0/2713588325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406eba0 0x7f37b4159b00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 --2- 172.21.15.17:0/2713588325 >> v2:172.21.15.17:3300/0 conn(0x7f37b406e7c0 0x7f37b40cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.295+0000 7f37ba000640 1 -- 172.21.15.17:0/2713588325 >> 172.21.15.17:0/2713588325 conn(0x7f37b406d770 msgr2=0x7f37b406db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:46.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.296+0000 7f37ba000640 1 -- 172.21.15.17:0/2713588325 shutdown_connections 2024-03-19T06:07:46.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.296+0000 7f37ba000640 1 -- 172.21.15.17:0/2713588325 wait complete. 2024-03-19T06:07:46.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.298+0000 7f37ba000640 1 Processor -- start 2024-03-19T06:07:46.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.299+0000 7f37ba000640 1 -- start start 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406e7c0 0x7f37b41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b406eba0 0x7f37b4155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c6f00 con 0x7f37b40c8910 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b40c7240 con 0x7f37b406eba0 2024-03-19T06:07:46.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.300+0000 7f37ba000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b4154090 con 0x7f37b406e7c0 2024-03-19T06:07:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.301+0000 7f37b9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.301+0000 7f37b9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59770/0 (socket says 172.21.15.17:59770) 2024-03-19T06:07:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.301+0000 7f37b9600640 1 -- 172.21.15.17:0/606075089 learned_addr learned my addr 172.21.15.17:0/606075089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:46.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.302+0000 7f37abe00640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b406eba0 0x7f37b4155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.302+0000 7f37b8c00640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406e7c0 0x7f37b41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.306+0000 7f37b9600640 1 -- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406e7c0 msgr2=0x7f37b41563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.306+0000 7f37b9600640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406e7c0 0x7f37b41563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.306+0000 7f37b9600640 1 -- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b406eba0 msgr2=0x7f37b4155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.306+0000 7f37b9600640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b406eba0 0x7f37b4155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.306+0000 7f37b9600640 1 -- 172.21.15.17:0/606075089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b41545b0 con 0x7f37b40c8910 2024-03-19T06:07:46.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.309+0000 7f37b9600640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c390 tx=0x7f37ac00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.315+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac017070 con 0x7f37b40c8910 2024-03-19T06:07:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.315+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac005ce0 con 0x7f37b40c8910 2024-03-19T06:07:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.315+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac007310 con 0x7f37b40c8910 2024-03-19T06:07:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.315+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4154890 con 0x7f37b40c8910 2024-03-19T06:07:46.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.316+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b4154e50 con 0x7f37b40c8910 2024-03-19T06:07:46.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.317+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b404f050 con 0x7f37b40c8910 2024-03-19T06:07:46.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.343+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f37ac01a070 con 0x7f37b40c8910 2024-03-19T06:07:46.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.345+0000 7f37b1600640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 0x7f379006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:46.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.345+0000 7f37b8c00640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 0x7f379006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:46.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.346+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f37ac056710 con 0x7f37b40c8910 2024-03-19T06:07:46.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.347+0000 7f37b8c00640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 0x7f379006e110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37a40113e0 tx=0x7f37a400b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:46.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.718+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f37ac021020 con 0x7f37b40c8910 2024-03-19T06:07:46.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.941+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f37b4071d40 con 0x7f37b40c8910 2024-03-19T06:07:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.950+0000 7f37b1600640 1 -- 172.21.15.17:0/606075089 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f37ac058670 con 0x7f37b40c8910 2024-03-19T06:07:46.940 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 msgr2=0x7f379006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 0x7f379006e110 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37a40113e0 tx=0x7f37a400b040 comp rx=0 tx=0).stop 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 msgr2=0x7f37b4155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00c390 tx=0x7f37ac00c850 comp rx=0 tx=0).stop 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 shutdown_connections 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37b40c8910 0x7f37b4155b90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f379006bc50 0x7f379006e110 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37b406eba0 0x7f37b4155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 --2- 172.21.15.17:0/606075089 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37b406e7c0 0x7f37b41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 >> 172.21.15.17:0/606075089 conn(0x7f37b406d770 msgr2=0x7f37b40c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.953+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 shutdown_connections 2024-03-19T06:07:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:46.954+0000 7f37ba000640 1 -- 172.21.15.17:0/606075089 wait complete. 2024-03-19T06:07:46.964 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:07:47.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.197+0000 7f74b3e00640 1 Processor -- start 2024-03-19T06:07:47.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.197+0000 7f74b3e00640 1 -- start start 2024-03-19T06:07:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74b4153df0 0x7f74b40c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b3e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f74b40717c0 0x7f74b415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b3e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b41541d0 con 0x7f74b40c5c50 2024-03-19T06:07:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b3e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b4159a50 con 0x7f74b4153df0 2024-03-19T06:07:47.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b3e00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b40c6b80 con 0x7f74b40717c0 2024-03-19T06:07:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.199+0000 7f74b2a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74b4153df0 0x7f74b40c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.200+0000 7f74b2000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f74b40c5c50 0x7f74b40710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48494/0 (socket says 172.21.15.17:48494) 2024-03-19T06:07:47.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.200+0000 7f74b2000640 1 -- 172.21.15.17:0/2108884703 learned_addr learned my addr 172.21.15.17:0/2108884703 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:47.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.200+0000 7f74b3400640 1 --2- 172.21.15.17:0/2108884703 >> v2:172.21.15.153:3300/0 conn(0x7f74b40717c0 0x7f74b415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.204+0000 7f74b2a00640 1 -- 172.21.15.17:0/2108884703 >> v2:172.21.15.153:3300/0 conn(0x7f74b40717c0 msgr2=0x7f74b415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.204+0000 7f74b2a00640 1 --2- 172.21.15.17:0/2108884703 >> v2:172.21.15.153:3300/0 conn(0x7f74b40717c0 0x7f74b415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.204+0000 7f74b2a00640 1 -- 172.21.15.17:0/2108884703 >> v1:172.21.15.17:6789/0 conn(0x7f74b40c5c50 legacy=0x7f74b40710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.204+0000 7f74b2a00640 1 -- 172.21.15.17:0/2108884703 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b40c6e60 con 0x7f74b4153df0 2024-03-19T06:07:47.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.208+0000 7f74b2a00640 1 --2- 172.21.15.17:0/2108884703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b40c53d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74b406de40 tx=0x7f74a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8d0a5779117955 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:47.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.214+0000 7f74b1600640 1 -- 172.21.15.17:0/2108884703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4034070 con 0x7f74b4153df0 2024-03-19T06:07:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.214+0000 7f74b1600640 1 -- 172.21.15.17:0/2108884703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4030610 con 0x7f74b4153df0 2024-03-19T06:07:47.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.214+0000 7f74b1600640 1 -- 172.21.15.17:0/2108884703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40309e0 con 0x7f74b4153df0 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 -- 172.21.15.17:0/2108884703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 msgr2=0x7f74b40c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 --2- 172.21.15.17:0/2108884703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b40c53d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f74b406de40 tx=0x7f74a402b960 comp rx=0 tx=0).stop 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 -- 172.21.15.17:0/2108884703 shutdown_connections 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 --2- 172.21.15.17:0/2108884703 >> v2:172.21.15.153:3300/0 conn(0x7f74b40717c0 0x7f74b415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 --2- 172.21.15.17:0/2108884703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b40c53d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 -- 172.21.15.17:0/2108884703 >> 172.21.15.17:0/2108884703 conn(0x7f74b406e630 msgr2=0x7f74b406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 -- 172.21.15.17:0/2108884703 shutdown_connections 2024-03-19T06:07:47.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.215+0000 7f74b3e00640 1 -- 172.21.15.17:0/2108884703 wait complete. 2024-03-19T06:07:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.217+0000 7f74b3e00640 1 Processor -- start 2024-03-19T06:07:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.217+0000 7f74b3e00640 1 -- start start 2024-03-19T06:07:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74b40717c0 0x7f74b4152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74b40c5c50 0x7f74b40cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4159ff0 con 0x7f74b4153df0 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4159d10 con 0x7f74b40717c0 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.218+0000 7f74b3e00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40c65d0 con 0x7f74b40c5c50 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.219+0000 7f74b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.219+0000 7f74b3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59776/0 (socket says 172.21.15.17:59776) 2024-03-19T06:07:47.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.219+0000 7f74b3400640 1 -- 172.21.15.17:0/1941362690 learned_addr learned my addr 172.21.15.17:0/1941362690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.219+0000 7f74b2a00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74b40717c0 0x7f74b4152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.220+0000 7f74b2000640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74b40c5c50 0x7f74b40cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.223+0000 7f74b3400640 1 -- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74b40c5c50 msgr2=0x7f74b40cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.223+0000 7f74b3400640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74b40c5c50 0x7f74b40cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.223+0000 7f74b3400640 1 -- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74b40717c0 msgr2=0x7f74b4152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.223+0000 7f74b3400640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74b40717c0 0x7f74b4152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.223+0000 7f74b3400640 1 -- 172.21.15.17:0/1941362690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b4146cf0 con 0x7f74b4153df0 2024-03-19T06:07:47.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.226+0000 7f74b3400640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00efc0 tx=0x7f74ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.231+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac018020 con 0x7f74b4153df0 2024-03-19T06:07:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.231+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac014480 con 0x7f74b4153df0 2024-03-19T06:07:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.231+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac014870 con 0x7f74b4153df0 2024-03-19T06:07:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.231+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b41efe10 con 0x7f74b4153df0 2024-03-19T06:07:47.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.231+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b415ae40 con 0x7f74b4153df0 2024-03-19T06:07:47.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.233+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b40686e0 con 0x7f74b4153df0 2024-03-19T06:07:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.256+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f74ac005d10 con 0x7f74b4153df0 2024-03-19T06:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.257+0000 7f74ab400640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 0x7f749406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.257+0000 7f74b2a00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 0x7f749406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.258+0000 7f74b2a00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 0x7f749406e110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74a4036000 tx=0x7f74a403b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.591+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f74ac058250 con 0x7f74b4153df0 2024-03-19T06:07:47.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.592+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f74ac022030 con 0x7f74b4153df0 2024-03-19T06:07:47.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.849+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74b404f050 con 0x7f74b4153df0 2024-03-19T06:07:47.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.907+0000 7f74ab400640 1 -- 172.21.15.17:0/1941362690 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f74ac010040 con 0x7f74b4153df0 2024-03-19T06:07:47.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:47.899 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:39.432640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4279,"mds_1":4264,"mds_2":4242,"mds_3":4241,"mds_4":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"a","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":2,"incarnation":15,"state":"up:active","state_seq":19,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:active","state_seq":18,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:07:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 msgr2=0x7f749406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 0x7f749406e110 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f74a4036000 tx=0x7f74a403b040 comp rx=0 tx=0).stop 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 msgr2=0x7f74b415b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00efc0 tx=0x7f74ac00c490 comp rx=0 tx=0).stop 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 shutdown_connections 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74b4153df0 0x7f74b415b640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f74b40c5c50 0x7f74b40cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f749406bc50 0x7f749406e110 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 --2- 172.21.15.17:0/1941362690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74b40717c0 0x7f74b4152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 >> 172.21.15.17:0/1941362690 conn(0x7f74b406e630 msgr2=0x7f74b40710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 shutdown_connections 2024-03-19T06:07:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:47.911+0000 7f74b3e00640 1 -- 172.21.15.17:0/1941362690 wait complete. 2024-03-19T06:07:47.926 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.158+0000 7f6a3a400640 1 Processor -- start 2024-03-19T06:07:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.159+0000 7f6a3a400640 1 -- start start 2024-03-19T06:07:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.160+0000 7f6a3a400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6a3415a7d0 0x7f6a3406c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.160+0000 7f6a3a400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3415d1d0 con 0x7f6a3406ccc0 2024-03-19T06:07:48.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.160+0000 7f6a3a400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3415d450 con 0x7f6a34153d90 2024-03-19T06:07:48.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.160+0000 7f6a3a400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a340cac30 con 0x7f6a3415a7d0 2024-03-19T06:07:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.163+0000 7f6a33400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6a34153d90 0x7f6a340ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:43608/0 (socket says 172.21.15.17:43608) 2024-03-19T06:07:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.163+0000 7f6a33400640 1 -- 172.21.15.17:0/1637982348 learned_addr learned my addr 172.21.15.17:0/1637982348 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.163+0000 7f6a32a00640 1 --2- 172.21.15.17:0/1637982348 >> v2:172.21.15.153:3300/0 conn(0x7f6a3415a7d0 0x7f6a3406c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:48.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.175+0000 7f6a32a00640 1 -- 172.21.15.17:0/1637982348 >> v1:172.21.15.153:6789/0 conn(0x7f6a34153d90 legacy=0x7f6a340ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.176+0000 7f6a32a00640 1 -- 172.21.15.17:0/1637982348 >> v1:172.21.15.17:6789/0 conn(0x7f6a3406ccc0 legacy=0x7f6a340cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:48.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.176+0000 7f6a32a00640 1 -- 172.21.15.17:0/1637982348 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3415d730 con 0x7f6a3415a7d0 2024-03-19T06:07:48.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.185+0000 7f6a32a00640 1 --2- 172.21.15.17:0/1637982348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3415a7d0 0x7f6a3406c780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a200097a0 tx=0x7f6a2002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef2d1c4338a9ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:48.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.196+0000 7f6a32000640 1 -- 172.21.15.17:0/1637982348 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20035020 con 0x7f6a3415a7d0 2024-03-19T06:07:48.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.196+0000 7f6a32000640 1 -- 172.21.15.17:0/1637982348 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20031830 con 0x7f6a3415a7d0 2024-03-19T06:07:48.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.196+0000 7f6a32000640 1 -- 172.21.15.17:0/1637982348 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20031c00 con 0x7f6a3415a7d0 2024-03-19T06:07:48.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.197+0000 7f6a3a400640 1 -- 172.21.15.17:0/1637982348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3415a7d0 msgr2=0x7f6a3406c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.197+0000 7f6a3a400640 1 --2- 172.21.15.17:0/1637982348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3415a7d0 0x7f6a3406c780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a200097a0 tx=0x7f6a2002b8d0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.198+0000 7f6a3a400640 1 -- 172.21.15.17:0/1637982348 shutdown_connections 2024-03-19T06:07:48.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.198+0000 7f6a3a400640 1 --2- 172.21.15.17:0/1637982348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3415a7d0 0x7f6a3406c780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.198+0000 7f6a3a400640 1 -- 172.21.15.17:0/1637982348 >> 172.21.15.17:0/1637982348 conn(0x7f6a34066e10 msgr2=0x7f6a3406bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:48.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.198+0000 7f6a3a400640 1 -- 172.21.15.17:0/1637982348 shutdown_connections 2024-03-19T06:07:48.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.198+0000 7f6a3a400640 1 -- 172.21.15.17:0/1637982348 wait complete. 2024-03-19T06:07:48.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.201+0000 7f6a3a400640 1 Processor -- start 2024-03-19T06:07:48.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.201+0000 7f6a3a400640 1 -- start start 2024-03-19T06:07:48.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:07:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3406ccc0 0x7f6a341f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:48.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a34153d90 0x7f6a341efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3415dcf0 con 0x7f6a3415a7d0 2024-03-19T06:07:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340ca850 con 0x7f6a3406ccc0 2024-03-19T06:07:48.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.203+0000 7f6a3a400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3415dfd0 con 0x7f6a34153d90 2024-03-19T06:07:48.200 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:07:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.207+0000 7f6a33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:48.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.207+0000 7f6a33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59782/0 (socket says 172.21.15.17:59782) 2024-03-19T06:07:48.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.207+0000 7f6a33e00640 1 -- 172.21.15.17:0/2216826824 learned_addr learned my addr 172.21.15.17:0/2216826824 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.212+0000 7f6a33e00640 1 -- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a34153d90 msgr2=0x7f6a341efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.212+0000 7f6a33e00640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a34153d90 0x7f6a341efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.212+0000 7f6a33e00640 1 -- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3406ccc0 msgr2=0x7f6a341f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.212+0000 7f6a33e00640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3406ccc0 0x7f6a341f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.212+0000 7f6a33e00640 1 -- 172.21.15.17:0/2216826824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34157ac0 con 0x7f6a3415a7d0 2024-03-19T06:07:48.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.217+0000 7f6a33e00640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00b490 tx=0x7f6a2c00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.223+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c015020 con 0x7f6a3415a7d0 2024-03-19T06:07:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.223+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c011850 con 0x7f6a3415a7d0 2024-03-19T06:07:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.223+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c011c40 con 0x7f6a3415a7d0 2024-03-19T06:07:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.223+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a34151860 con 0x7f6a3415a7d0 2024-03-19T06:07:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.223+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a341f3400 con 0x7f6a3415a7d0 2024-03-19T06:07:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.224+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a34069be0 con 0x7f6a3415a7d0 2024-03-19T06:07:48.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.249+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6a2c018020 con 0x7f6a3415a7d0 2024-03-19T06:07:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.250+0000 7f6a2b400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 0x7f6a1406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:48.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.250+0000 7f6a33400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 0x7f6a1406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:48.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.251+0000 7f6a33400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 0x7f6a1406e0e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001fd0 tx=0x7f6a240015c0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:48.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.555+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6a2c011de0 con 0x7f6a3415a7d0 2024-03-19T06:07:48.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.556+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f6a2c01f020 con 0x7f6a3415a7d0 2024-03-19T06:07:48.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.782+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a340b2300 con 0x7f6a3415a7d0 2024-03-19T06:07:48.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.858+0000 7f6a2b400640 1 -- 172.21.15.17:0/2216826824 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f6a2c059a40 con 0x7f6a3415a7d0 2024-03-19T06:07:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:48.853 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.861+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 msgr2=0x7f6a1406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.861+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 0x7f6a1406e0e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001fd0 tx=0x7f6a240015c0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.861+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 msgr2=0x7f6a340cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.861+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00b490 tx=0x7f6a2c00b950 comp rx=0 tx=0).stop 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 shutdown_connections 2024-03-19T06:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a3415a7d0 0x7f6a340cbe20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f6a34153d90 0x7f6a341efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f6a1406bc20 0x7f6a1406e0e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 --2- 172.21.15.17:0/2216826824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a3406ccc0 0x7f6a341f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 >> 172.21.15.17:0/2216826824 conn(0x7f6a34066e10 msgr2=0x7f6a340ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 shutdown_connections 2024-03-19T06:07:48.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:48.862+0000 7f6a3a400640 1 -- 172.21.15.17:0/2216826824 wait complete. 2024-03-19T06:07:48.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:07:48.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:07:49.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.109+0000 7f87eb800640 1 Processor -- start 2024-03-19T06:07:49.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.109+0000 7f87eb800640 1 -- start start 2024-03-19T06:07:49.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.111+0000 7f87eb800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f87e40c1e60 0x7f87e40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:49.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.111+0000 7f87eb800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40c27c0 con 0x7f87e4151f70 2024-03-19T06:07:49.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.111+0000 7f87eb800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e4157be0 con 0x7f87e415b1d0 2024-03-19T06:07:49.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.111+0000 7f87eb800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e4157f30 con 0x7f87e40c1e60 2024-03-19T06:07:49.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.112+0000 7f87e8e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f87e4151f70 0x7f87e41583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:48518/0 (socket says 172.21.15.17:48518) 2024-03-19T06:07:49.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.112+0000 7f87e8e00640 1 -- 172.21.15.17:0/811137705 learned_addr learned my addr 172.21.15.17:0/811137705 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:49.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.116+0000 7f87e9800640 1 --2- 172.21.15.17:0/811137705 >> v2:172.21.15.17:3300/0 conn(0x7f87e40c1e60 0x7f87e40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.116+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279398936 0 0) 0x7f87e40c27c0 con 0x7f87e4151f70 2024-03-19T06:07:49.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.116+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87cc003520 con 0x7f87e4151f70 2024-03-19T06:07:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.120+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576557492 0 0) 0x7f87e4157be0 con 0x7f87e415b1d0 2024-03-19T06:07:49.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.120+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e40c27c0 con 0x7f87e415b1d0 2024-03-19T06:07:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.123+0000 7f87e9800640 1 -- 172.21.15.17:0/811137705 >> v1:172.21.15.153:6789/0 conn(0x7f87e415b1d0 legacy=0x7f87e406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.123+0000 7f87e9800640 1 -- 172.21.15.17:0/811137705 >> v1:172.21.15.17:6789/0 conn(0x7f87e4151f70 legacy=0x7f87e41583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.123+0000 7f87e9800640 1 -- 172.21.15.17:0/811137705 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e415b730 con 0x7f87e40c1e60 2024-03-19T06:07:49.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.127+0000 7f87e9800640 1 --2- 172.21.15.17:0/811137705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e40c1e60 0x7f87e40c7760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f87e41580b0 tx=0x7f87dc02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711dee6103a44750 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.133+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc039070 con 0x7f87e40c1e60 2024-03-19T06:07:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.133+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc02cd80 con 0x7f87e40c1e60 2024-03-19T06:07:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.133+0000 7f87e3400640 1 -- 172.21.15.17:0/811137705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc034660 con 0x7f87e40c1e60 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.134+0000 7f87eb800640 1 -- 172.21.15.17:0/811137705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e40c1e60 msgr2=0x7f87e40c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.134+0000 7f87eb800640 1 --2- 172.21.15.17:0/811137705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e40c1e60 0x7f87e40c7760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f87e41580b0 tx=0x7f87dc02bfd0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.134+0000 7f87eb800640 1 -- 172.21.15.17:0/811137705 shutdown_connections 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.134+0000 7f87eb800640 1 --2- 172.21.15.17:0/811137705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e40c1e60 0x7f87e40c7760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.134+0000 7f87eb800640 1 -- 172.21.15.17:0/811137705 >> 172.21.15.17:0/811137705 conn(0x7f87e40c8910 msgr2=0x7f87e40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.135+0000 7f87eb800640 1 -- 172.21.15.17:0/811137705 shutdown_connections 2024-03-19T06:07:49.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.135+0000 7f87eb800640 1 -- 172.21.15.17:0/811137705 wait complete. 2024-03-19T06:07:49.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.136+0000 7f87eb800640 1 Processor -- start 2024-03-19T06:07:49.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.137+0000 7f87eb800640 1 -- start start 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.137+0000 7f87eb800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87e40c1e60 0x7f87e41536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87eb800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87eb800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87e415b1d0 0x7f87e40cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87eb800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e415bcf0 con 0x7f87e4151f70 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87eb800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4152350 con 0x7f87e40c1e60 2024-03-19T06:07:49.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87eb800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e415bfd0 con 0x7f87e415b1d0 2024-03-19T06:07:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.138+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.139+0000 7f87e3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59798/0 (socket says 172.21.15.17:59798) 2024-03-19T06:07:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.139+0000 7f87e3e00640 1 -- 172.21.15.17:0/1707154498 learned_addr learned my addr 172.21.15.17:0/1707154498 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:49.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.139+0000 7f87e8e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87e40c1e60 0x7f87e41536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:49.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.140+0000 7f87e9800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87e415b1d0 0x7f87e40cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:49.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.143+0000 7f87e3e00640 1 -- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87e415b1d0 msgr2=0x7f87e40cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.143+0000 7f87e3e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87e415b1d0 0x7f87e40cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.143+0000 7f87e3e00640 1 -- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87e40c1e60 msgr2=0x7f87e41536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.143+0000 7f87e3e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87e40c1e60 0x7f87e41536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.143+0000 7f87e3e00640 1 -- 172.21.15.17:0/1707154498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e41ebc10 con 0x7f87e4151f70 2024-03-19T06:07:49.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.145+0000 7f87e3e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c430 tx=0x7f87d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.149+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0017070 con 0x7f87e4151f70 2024-03-19T06:07:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.150+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d00052f0 con 0x7f87e4151f70 2024-03-19T06:07:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.150+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d0003830 con 0x7f87e4151f70 2024-03-19T06:07:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.150+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e4153c10 con 0x7f87e4151f70 2024-03-19T06:07:49.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.150+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e414ef50 con 0x7f87e4151f70 2024-03-19T06:07:49.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.151+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e4069be0 con 0x7f87e4151f70 2024-03-19T06:07:49.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.472+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f87d001a070 con 0x7f87e4151f70 2024-03-19T06:07:49.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.474+0000 7f87e0c00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 0x7f87c406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:49.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.475+0000 7f87e8e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 0x7f87c406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:49.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.476+0000 7f87e8e00640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 0x7f87c406e0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001200 tx=0x7f87d8000bc0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.533+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f87d0056770 con 0x7f87e4151f70 2024-03-19T06:07:49.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.534+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f87d0021020 con 0x7f87e4151f70 2024-03-19T06:07:49.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.760+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87e41570a0 con 0x7f87e4151f70 2024-03-19T06:07:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.775+0000 7f87e0c00640 1 -- 172.21.15.17:0/1707154498 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87d00586d0 con 0x7f87e4151f70 2024-03-19T06:07:49.766 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:07:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 msgr2=0x7f87c406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 0x7f87c406e0e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001200 tx=0x7f87d8000bc0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 msgr2=0x7f87e414cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f87d000c430 tx=0x7f87d000c8f0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 shutdown_connections 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f87e415b1d0 0x7f87e40cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f87e4151f70 0x7f87e414cd10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f87c406bc20 0x7f87c406e0e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 --2- 172.21.15.17:0/1707154498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87e40c1e60 0x7f87e41536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.778+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 >> 172.21.15.17:0/1707154498 conn(0x7f87e40c8910 msgr2=0x7f87e4159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.779+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 shutdown_connections 2024-03-19T06:07:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:49.779+0000 7f87eb800640 1 -- 172.21.15.17:0/1707154498 wait complete. 2024-03-19T06:07:49.789 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:07:50.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.019+0000 7f84b8800640 1 Processor -- start 2024-03-19T06:07:50.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.019+0000 7f84b8800640 1 -- start start 2024-03-19T06:07:50.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.020+0000 7f84b8800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f84b015b1d0 0x7f84b00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.020+0000 7f84b8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b00c1e60 0x7f84b006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.020+0000 7f84b8800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00c27c0 con 0x7f84b0151f70 2024-03-19T06:07:50.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.020+0000 7f84b8800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b0157f30 con 0x7f84b015b1d0 2024-03-19T06:07:50.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.020+0000 7f84b8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b0152350 con 0x7f84b00c1e60 2024-03-19T06:07:50.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.021+0000 7f84b5e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f84b0151f70 0x7f84b01583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41878/0 (socket says 172.21.15.17:41878) 2024-03-19T06:07:50.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.021+0000 7f84b5e00640 1 -- 172.21.15.17:0/3156130645 learned_addr learned my addr 172.21.15.17:0/3156130645 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:50.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.022+0000 7f84b5400640 1 --2- 172.21.15.17:0/3156130645 >> v2:172.21.15.153:3300/0 conn(0x7f84b015b1d0 0x7f84b00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.022+0000 7f84b6800640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b00c1e60 0x7f84b006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.025+0000 7f84b4a00640 1 -- 172.21.15.17:0/3156130645 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739679474 0 0) 0x7f84b00c27c0 con 0x7f84b0151f70 2024-03-19T06:07:50.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.025+0000 7f84b4a00640 1 -- 172.21.15.17:0/3156130645 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8498003520 con 0x7f84b0151f70 2024-03-19T06:07:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.030+0000 7f84b5400640 1 -- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b00c1e60 msgr2=0x7f84b006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.030+0000 7f84b5400640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b00c1e60 0x7f84b006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.030+0000 7f84b5400640 1 -- 172.21.15.17:0/3156130645 >> v1:172.21.15.17:6789/0 conn(0x7f84b0151f70 legacy=0x7f84b01583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.030+0000 7f84b5400640 1 -- 172.21.15.17:0/3156130645 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0157be0 con 0x7f84b015b1d0 2024-03-19T06:07:50.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.036+0000 7f84b5400640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b015b1d0 0x7f84b00c7760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097a0 tx=0x7f84a002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcda129f2e94d61b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.046+0000 7f84b4a00640 1 -- 172.21.15.17:0/3156130645 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0034070 con 0x7f84b015b1d0 2024-03-19T06:07:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.046+0000 7f84b4a00640 1 -- 172.21.15.17:0/3156130645 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0030800 con 0x7f84b015b1d0 2024-03-19T06:07:50.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.046+0000 7f84b4a00640 1 -- 172.21.15.17:0/3156130645 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0030bd0 con 0x7f84b015b1d0 2024-03-19T06:07:50.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 -- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b015b1d0 msgr2=0x7f84b00c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b015b1d0 0x7f84b00c7760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f84a00097a0 tx=0x7f84a002b940 comp rx=0 tx=0).stop 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 -- 172.21.15.17:0/3156130645 shutdown_connections 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b00c1e60 0x7f84b006e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 --2- 172.21.15.17:0/3156130645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b015b1d0 0x7f84b00c7760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 -- 172.21.15.17:0/3156130645 >> 172.21.15.17:0/3156130645 conn(0x7f84b00c8910 msgr2=0x7f84b00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 -- 172.21.15.17:0/3156130645 shutdown_connections 2024-03-19T06:07:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.047+0000 7f84b8800640 1 -- 172.21.15.17:0/3156130645 wait complete. 2024-03-19T06:07:50.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.049+0000 7f84b8800640 1 Processor -- start 2024-03-19T06:07:50.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.049+0000 7f84b8800640 1 -- start start 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b0151f70 0x7f84b014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b015b1d0 0x7f84b01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b015bcf0 con 0x7f84b00c1e60 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b015ba10 con 0x7f84b0151f70 2024-03-19T06:07:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.050+0000 7f84b8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b015bfd0 con 0x7f84b015b1d0 2024-03-19T06:07:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.051+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.051+0000 7f84b5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56806/0 (socket says 172.21.15.17:56806) 2024-03-19T06:07:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.051+0000 7f84b5e00640 1 -- 172.21.15.17:0/3994320577 learned_addr learned my addr 172.21.15.17:0/3994320577 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:50.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.052+0000 7f84b5400640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b0151f70 0x7f84b014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.055+0000 7f84b5e00640 1 -- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b015b1d0 msgr2=0x7f84b01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.055+0000 7f84b5e00640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b015b1d0 0x7f84b01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.055+0000 7f84b5e00640 1 -- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b0151f70 msgr2=0x7f84b014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.055+0000 7f84b5e00640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b0151f70 0x7f84b014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.055+0000 7f84b5e00640 1 -- 172.21.15.17:0/3994320577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b0148ec0 con 0x7f84b00c1e60 2024-03-19T06:07:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.058+0000 7f84b5e00640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c430 tx=0x7f84a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.062+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4017070 con 0x7f84b00c1e60 2024-03-19T06:07:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.062+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a4005ce0 con 0x7f84b00c1e60 2024-03-19T06:07:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.063+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4007310 con 0x7f84b00c1e60 2024-03-19T06:07:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.063+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b01f0690 con 0x7f84b00c1e60 2024-03-19T06:07:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.063+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b01512e0 con 0x7f84b00c1e60 2024-03-19T06:07:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.064+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b0069be0 con 0x7f84b00c1e60 2024-03-19T06:07:50.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.100+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f84a401a070 con 0x7f84b00c1e60 2024-03-19T06:07:50.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.102+0000 7f84aa000640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 0x7f849406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.102+0000 7f84b5400640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 0x7f849406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.104+0000 7f84b5400640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 0x7f849406e110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f84a0036000 tx=0x7f84a003b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:50.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.405+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f84a4056780 con 0x7f84b00c1e60 2024-03-19T06:07:50.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.406+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f84a4021020 con 0x7f84b00c1e60 2024-03-19T06:07:50.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.633+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f84b00c7200 con 0x7f84b00c1e60 2024-03-19T06:07:50.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.656+0000 7f84aa000640 1 -- 172.21.15.17:0/3994320577 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f84a40586e0 con 0x7f84b00c1e60 2024-03-19T06:07:50.647 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 msgr2=0x7f849406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 0x7f849406e110 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f84a0036000 tx=0x7f84a003b040 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 msgr2=0x7f84b014e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c430 tx=0x7f84a400c8f0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 shutdown_connections 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f84b015b1d0 0x7f84b01596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f849406bc50 0x7f849406e110 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84b0151f70 0x7f84b014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 --2- 172.21.15.17:0/3994320577 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84b00c1e60 0x7f84b014e270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 >> 172.21.15.17:0/3994320577 conn(0x7f84b00c8910 msgr2=0x7f84b00c2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:50.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.659+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 shutdown_connections 2024-03-19T06:07:50.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.660+0000 7f84b8800640 1 -- 172.21.15.17:0/3994320577 wait complete. 2024-03-19T06:07:50.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:07:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.895+0000 7f8cafa00640 1 Processor -- start 2024-03-19T06:07:50.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.896+0000 7f8cafa00640 1 -- start start 2024-03-19T06:07:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.897+0000 7f8cafa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.897+0000 7f8cafa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8ca806c820 0x7f8ca806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.897+0000 7f8cafa00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca8154150 con 0x7f8ca8153d70 2024-03-19T06:07:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.897+0000 7f8cafa00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80cbb50 con 0x7f8ca806c820 2024-03-19T06:07:50.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.897+0000 7f8cafa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815e1c0 con 0x7f8ca815d840 2024-03-19T06:07:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.899+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.900+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:55806/0 (socket says 172.21.15.17:55806) 2024-03-19T06:07:50.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.900+0000 7f8ca7e00640 1 -- 172.21.15.17:0/1389671718 learned_addr learned my addr 172.21.15.17:0/1389671718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:50.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.907+0000 7f8ca7e00640 1 -- 172.21.15.17:0/1389671718 >> v2:172.21.15.17:3300/0 conn(0x7f8ca806c820 msgr2=0x7f8ca806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:50.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.907+0000 7f8ca7e00640 1 --2- 172.21.15.17:0/1389671718 >> v2:172.21.15.17:3300/0 conn(0x7f8ca806c820 0x7f8ca806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.907+0000 7f8ca7e00640 1 -- 172.21.15.17:0/1389671718 >> v1:172.21.15.17:6789/0 conn(0x7f8ca8153d70 legacy=0x7f8ca80c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:50.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.907+0000 7f8ca7e00640 1 -- 172.21.15.17:0/1389671718 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca815ac10 con 0x7f8ca815d840 2024-03-19T06:07:50.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.917+0000 7f8ca7e00640 1 --2- 172.21.15.17:0/1389671718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80c9c20 tx=0x7f8c9002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e756851e2548bc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:50.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.928+0000 7f8ca7400640 1 -- 172.21.15.17:0/1389671718 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90004230 con 0x7f8ca815d840 2024-03-19T06:07:50.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.928+0000 7f8ca7400640 1 -- 172.21.15.17:0/1389671718 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c900043d0 con 0x7f8ca815d840 2024-03-19T06:07:50.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.928+0000 7f8ca7400640 1 -- 172.21.15.17:0/1389671718 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90003810 con 0x7f8ca815d840 2024-03-19T06:07:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.929+0000 7f8cafa00640 1 -- 172.21.15.17:0/1389671718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 msgr2=0x7f8ca815dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.929+0000 7f8cafa00640 1 --2- 172.21.15.17:0/1389671718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8ca80c9c20 tx=0x7f8c9002b960 comp rx=0 tx=0).stop 2024-03-19T06:07:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 -- 172.21.15.17:0/1389671718 shutdown_connections 2024-03-19T06:07:50.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 --2- 172.21.15.17:0/1389671718 >> v2:172.21.15.17:3300/0 conn(0x7f8ca806c820 0x7f8ca806cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 --2- 172.21.15.17:0/1389671718 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca815dc80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 -- 172.21.15.17:0/1389671718 >> 172.21.15.17:0/1389671718 conn(0x7f8ca8066e10 msgr2=0x7f8ca806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:50.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 -- 172.21.15.17:0/1389671718 shutdown_connections 2024-03-19T06:07:50.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.930+0000 7f8cafa00640 1 -- 172.21.15.17:0/1389671718 wait complete. 2024-03-19T06:07:50.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.932+0000 7f8cafa00640 1 Processor -- start 2024-03-19T06:07:50.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.933+0000 7f8cafa00640 1 -- start start 2024-03-19T06:07:50.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca806c820 0x7f8ca814bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca81f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:50.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815a650 con 0x7f8ca806c820 2024-03-19T06:07:50.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815a370 con 0x7f8ca8153d70 2024-03-19T06:07:50.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.934+0000 7f8cafa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca815a930 con 0x7f8ca815d840 2024-03-19T06:07:50.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.936+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.937+0000 7f8ca7e00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:35800/0 (socket says 172.21.15.17:35800) 2024-03-19T06:07:50.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.937+0000 7f8ca7e00640 1 -- 172.21.15.17:0/959256777 learned_addr learned my addr 172.21.15.17:0/959256777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:50.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.940+0000 7f8cada00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca81f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:50.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.948+0000 7f8ca7e00640 1 -- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 msgr2=0x7f8ca81f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.948+0000 7f8ca7e00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca81f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.948+0000 7f8ca7e00640 1 -- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca806c820 msgr2=0x7f8ca814bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:50.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.948+0000 7f8ca7e00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca806c820 0x7f8ca814bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:50.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.948+0000 7f8ca7e00640 1 -- 172.21.15.17:0/959256777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8157a00 con 0x7f8ca8153d70 2024-03-19T06:07:50.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.955+0000 7f8ca7e00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002b9a0 tx=0x7f8c900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.966+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90047070 con 0x7f8ca8153d70 2024-03-19T06:07:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.966+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c90003b50 con 0x7f8ca8153d70 2024-03-19T06:07:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.966+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90006040 con 0x7f8ca8153d70 2024-03-19T06:07:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.966+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca8157f80 con 0x7f8ca8153d70 2024-03-19T06:07:50.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.967+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca814afd0 con 0x7f8ca8153d70 2024-03-19T06:07:50.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:50.968+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca8069be0 con 0x7f8ca8153d70 2024-03-19T06:07:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.323+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8c9004a070 con 0x7f8ca8153d70 2024-03-19T06:07:51.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.325+0000 7f8ca4c00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 0x7f8c8406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.326+0000 7f8cad000640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 0x7f8c8406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.329+0000 7f8cad000640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 0x7f8c8406e0e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c98001c60 tx=0x7f8c98007d10 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:51.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.334+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8c90078d10 con 0x7f8ca8153d70 2024-03-19T06:07:51.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.368+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f8c90051020 con 0x7f8ca8153d70 2024-03-19T06:07:51.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.586+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ca80caa70 con 0x7f8ca8153d70 2024-03-19T06:07:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.596+0000 7f8ca4c00640 1 -- 172.21.15.17:0/959256777 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c90034020 con 0x7f8ca8153d70 2024-03-19T06:07:51.587 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 msgr2=0x7f8c8406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 0x7f8c8406e0e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c98001c60 tx=0x7f8c98007d10 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 msgr2=0x7f8ca81582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c9002b9a0 tx=0x7f8c900046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 shutdown_connections 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8ca815d840 0x7f8ca81f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8c8406bc20 0x7f8c8406e0e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ca8153d70 0x7f8ca81582b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 --2- 172.21.15.17:0/959256777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ca806c820 0x7f8ca814bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 >> 172.21.15.17:0/959256777 conn(0x7f8ca8066e10 msgr2=0x7f8ca81e3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:51.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.599+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 shutdown_connections 2024-03-19T06:07:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.600+0000 7f8cafa00640 1 -- 172.21.15.17:0/959256777 wait complete. 2024-03-19T06:07:51.611 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:07:51.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.850+0000 7f7b8b600640 1 Processor -- start 2024-03-19T06:07:51.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.851+0000 7f7b8b600640 1 -- start start 2024-03-19T06:07:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.852+0000 7f7b8b600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b84150dc0 0x7f7b840c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.852+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b840c72d0 0x7f7b8406e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.852+0000 7f7b8b600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b84157650 con 0x7f7b8415ae50 2024-03-19T06:07:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.852+0000 7f7b8b600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8415a120 con 0x7f7b84150dc0 2024-03-19T06:07:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.852+0000 7f7b8b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b84157930 con 0x7f7b840c72d0 2024-03-19T06:07:51.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.853+0000 7f7b88c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b84150dc0 0x7f7b840c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.853+0000 7f7b88c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7b84150dc0 0x7f7b840c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56840/0 (socket says 172.21.15.17:56840) 2024-03-19T06:07:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.853+0000 7f7b88c00640 1 -- 172.21.15.17:0/3775649788 learned_addr learned my addr 172.21.15.17:0/3775649788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.854+0000 7f7b89600640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b840c72d0 0x7f7b8406e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.856+0000 7f7b88c00640 1 -- 172.21.15.17:0/3775649788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b840c72d0 msgr2=0x7f7b8406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.856+0000 7f7b88c00640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b840c72d0 0x7f7b8406e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.856+0000 7f7b88c00640 1 -- 172.21.15.17:0/3775649788 >> v1:172.21.15.153:6789/0 conn(0x7f7b8415ae50 legacy=0x7f7b84156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.856+0000 7f7b88c00640 1 -- 172.21.15.17:0/3775649788 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8415a370 con 0x7f7b84150dc0 2024-03-19T06:07:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.859+0000 7f7b88c00640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b84150dc0 0x7f7b840c46a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bb10 tx=0x7f7b7802e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1ed3c3b146e22e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.862+0000 7f7b83400640 1 -- 172.21.15.17:0/3775649788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7803b070 con 0x7f7b84150dc0 2024-03-19T06:07:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b83400640 1 -- 172.21.15.17:0/3775649788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78036440 con 0x7f7b84150dc0 2024-03-19T06:07:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b83400640 1 -- 172.21.15.17:0/3775649788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78036810 con 0x7f7b84150dc0 2024-03-19T06:07:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 -- 172.21.15.17:0/3775649788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b84150dc0 msgr2=0x7f7b840c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b84150dc0 0x7f7b840c46a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bb10 tx=0x7f7b7802e150 comp rx=0 tx=0).stop 2024-03-19T06:07:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 -- 172.21.15.17:0/3775649788 shutdown_connections 2024-03-19T06:07:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b840c72d0 0x7f7b8406e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 --2- 172.21.15.17:0/3775649788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b84150dc0 0x7f7b840c46a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.863+0000 7f7b8b600640 1 -- 172.21.15.17:0/3775649788 >> 172.21.15.17:0/3775649788 conn(0x7f7b840c8910 msgr2=0x7f7b840cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.864+0000 7f7b8b600640 1 -- 172.21.15.17:0/3775649788 shutdown_connections 2024-03-19T06:07:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.864+0000 7f7b8b600640 1 -- 172.21.15.17:0/3775649788 wait complete. 2024-03-19T06:07:51.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.866+0000 7f7b8b600640 1 Processor -- start 2024-03-19T06:07:51.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.866+0000 7f7b8b600640 1 -- start start 2024-03-19T06:07:51.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b84150dc0 0x7f7b841eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b8415ae50 0x7f7b841ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b840c4be0 con 0x7f7b840c72d0 2024-03-19T06:07:51.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8415a930 con 0x7f7b84150dc0 2024-03-19T06:07:51.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b8b600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b841511a0 con 0x7f7b8415ae50 2024-03-19T06:07:51.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.867+0000 7f7b88c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.868+0000 7f7b88c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56852/0 (socket says 172.21.15.17:56852) 2024-03-19T06:07:51.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.868+0000 7f7b88c00640 1 -- 172.21.15.17:0/2251824389 learned_addr learned my addr 172.21.15.17:0/2251824389 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:51.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.868+0000 7f7b83e00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b84150dc0 0x7f7b841eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.868+0000 7f7b89600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b8415ae50 0x7f7b841ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.872+0000 7f7b88c00640 1 -- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b8415ae50 msgr2=0x7f7b841ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.872+0000 7f7b88c00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b8415ae50 0x7f7b841ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.872+0000 7f7b88c00640 1 -- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b84150dc0 msgr2=0x7f7b841eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.872+0000 7f7b88c00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b84150dc0 0x7f7b841eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.872+0000 7f7b88c00640 1 -- 172.21.15.17:0/2251824389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b841e2e80 con 0x7f7b840c72d0 2024-03-19T06:07:51.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.875+0000 7f7b88c00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bc30 tx=0x7f7b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:51.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.880+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7803b040 con 0x7f7b840c72d0 2024-03-19T06:07:51.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.880+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78044070 con 0x7f7b840c72d0 2024-03-19T06:07:51.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.880+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780349c0 con 0x7f7b840c72d0 2024-03-19T06:07:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.880+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b840b8220 con 0x7f7b840c72d0 2024-03-19T06:07:51.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.880+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b841e1380 con 0x7f7b840c72d0 2024-03-19T06:07:51.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.881+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b84069be0 con 0x7f7b840c72d0 2024-03-19T06:07:51.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.905+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7b78034b60 con 0x7f7b840c72d0 2024-03-19T06:07:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.906+0000 7f7b80c00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 0x7f7b6406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:51.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.907+0000 7f7b83e00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 0x7f7b6406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.907+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7b78079c10 con 0x7f7b840c72d0 2024-03-19T06:07:51.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:51.908+0000 7f7b83e00640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 0x7f7b6406e110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b841591a0 tx=0x7f7b70009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:52.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.236+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f7b7807bb70 con 0x7f7b840c72d0 2024-03-19T06:07:52.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.468+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7b84070d70 con 0x7f7b840c72d0 2024-03-19T06:07:52.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.476+0000 7f7b80c00640 1 -- 172.21.15.17:0/2251824389 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b7807fc10 con 0x7f7b840c72d0 2024-03-19T06:07:52.467 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:07:52.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.478+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 msgr2=0x7f7b6406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 0x7f7b6406e110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b841591a0 tx=0x7f7b70009040 comp rx=0 tx=0).stop 2024-03-19T06:07:52.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 msgr2=0x7f7b8406e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bc30 tx=0x7f7b780046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 shutdown_connections 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b8415ae50 0x7f7b841ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b6406bc50 0x7f7b6406e110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b84150dc0 0x7f7b841eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 --2- 172.21.15.17:0/2251824389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b840c72d0 0x7f7b8406e970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 >> 172.21.15.17:0/2251824389 conn(0x7f7b840c8910 msgr2=0x7f7b84070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 shutdown_connections 2024-03-19T06:07:52.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.479+0000 7f7b8b600640 1 -- 172.21.15.17:0/2251824389 wait complete. 2024-03-19T06:07:52.488 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:07:52.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.698+0000 7f2412400640 1 Processor -- start 2024-03-19T06:07:52.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.699+0000 7f2412400640 1 -- start start 2024-03-19T06:07:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.700+0000 7f2412400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f240c159c10 0x7f240c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.700+0000 7f2412400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c15a200 con 0x7f240c15dc60 2024-03-19T06:07:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.700+0000 7f2412400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240c15a4c0 con 0x7f240c0c9410 2024-03-19T06:07:52.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.700+0000 7f2412400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240c15e0d0 con 0x7f240c159c10 2024-03-19T06:07:52.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.702+0000 7f240be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f240c159c10 0x7f240c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:52.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.702+0000 7f2411a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f240c15dc60 0x7f240c0caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41902/0 (socket says 172.21.15.17:41902) 2024-03-19T06:07:52.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.702+0000 7f2411a00640 1 -- 172.21.15.17:0/3433981029 learned_addr learned my addr 172.21.15.17:0/3433981029 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.708+0000 7f240be00640 1 -- 172.21.15.17:0/3433981029 >> v1:172.21.15.153:6789/0 conn(0x7f240c0c9410 legacy=0x7f240c0ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.708+0000 7f240be00640 1 -- 172.21.15.17:0/3433981029 >> v1:172.21.15.17:6789/0 conn(0x7f240c15dc60 legacy=0x7f240c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.708+0000 7f240be00640 1 -- 172.21.15.17:0/3433981029 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c15a7a0 con 0x7f240c159c10 2024-03-19T06:07:52.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.714+0000 7f240be00640 1 --2- 172.21.15.17:0/3433981029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c15b080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7183712112e45338 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.717+0000 7f240b400640 1 -- 172.21.15.17:0/3433981029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4034070 con 0x7f240c159c10 2024-03-19T06:07:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.717+0000 7f240b400640 1 -- 172.21.15.17:0/3433981029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4030610 con 0x7f240c159c10 2024-03-19T06:07:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.718+0000 7f240b400640 1 -- 172.21.15.17:0/3433981029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40309e0 con 0x7f240c159c10 2024-03-19T06:07:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.718+0000 7f2412400640 1 -- 172.21.15.17:0/3433981029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 msgr2=0x7f240c15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.718+0000 7f2412400640 1 --2- 172.21.15.17:0/3433981029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c15b080 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f23f40097a0 tx=0x7f23f402b960 comp rx=0 tx=0).stop 2024-03-19T06:07:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.719+0000 7f2412400640 1 -- 172.21.15.17:0/3433981029 shutdown_connections 2024-03-19T06:07:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.719+0000 7f2412400640 1 --2- 172.21.15.17:0/3433981029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c15b080 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.719+0000 7f2412400640 1 -- 172.21.15.17:0/3433981029 >> 172.21.15.17:0/3433981029 conn(0x7f240c072360 msgr2=0x7f240c072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.719+0000 7f2412400640 1 -- 172.21.15.17:0/3433981029 shutdown_connections 2024-03-19T06:07:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.719+0000 7f2412400640 1 -- 172.21.15.17:0/3433981029 wait complete. 2024-03-19T06:07:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.721+0000 7f2412400640 1 Processor -- start 2024-03-19T06:07:52.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.722+0000 7f2412400640 1 -- start start 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f240c0c9410 0x7f240c151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f240c15dc60 0x7f240c0c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15d180 con 0x7f240c159c10 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240c0caac0 con 0x7f240c15dc60 2024-03-19T06:07:52.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.723+0000 7f2412400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240c15d460 con 0x7f240c0c9410 2024-03-19T06:07:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.724+0000 7f240be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.724+0000 7f240be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56876/0 (socket says 172.21.15.17:56876) 2024-03-19T06:07:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.724+0000 7f240be00640 1 -- 172.21.15.17:0/3735529741 learned_addr learned my addr 172.21.15.17:0/3735529741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:52.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.725+0000 7f2411a00640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f240c15dc60 0x7f240c0c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:52.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.726+0000 7f2411000640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f240c0c9410 0x7f240c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.729+0000 7f240be00640 1 -- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f240c0c9410 msgr2=0x7f240c151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.729+0000 7f240be00640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f240c0c9410 0x7f240c151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.729+0000 7f240be00640 1 -- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f240c15dc60 msgr2=0x7f240c0c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.729+0000 7f240be00640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f240c15dc60 0x7f240c0c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:52.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.729+0000 7f240be00640 1 -- 172.21.15.17:0/3735529741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c14ec00 con 0x7f240c159c10 2024-03-19T06:07:52.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.732+0000 7f240be00640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009890 tx=0x7f23f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.736+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4034040 con 0x7f240c159c10 2024-03-19T06:07:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.736+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4039a10 con 0x7f240c159c10 2024-03-19T06:07:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.736+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4039de0 con 0x7f240c159c10 2024-03-19T06:07:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.736+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240c14eee0 con 0x7f240c159c10 2024-03-19T06:07:52.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.736+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240c14f4a0 con 0x7f240c159c10 2024-03-19T06:07:52.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.738+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240c04f050 con 0x7f240c159c10 2024-03-19T06:07:52.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.760+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f23f4037070 con 0x7f240c159c10 2024-03-19T06:07:52.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.762+0000 7f2408c00640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 0x7f23e806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:52.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.763+0000 7f2411000640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 0x7f23e806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:52.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.764+0000 7f2411000640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 0x7f23e806e110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0012e0 tx=0x7f23fc009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:52.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:52.920+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f23f40799f0 con 0x7f240c159c10 2024-03-19T06:07:53.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.064+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f23f407b950 con 0x7f240c159c10 2024-03-19T06:07:53.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.337+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f240c14f670 con 0x7f240c159c10 2024-03-19T06:07:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.424+0000 7f2408c00640 1 -- 172.21.15.17:0/3735529741 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f23f407f9f0 con 0x7f240c159c10 2024-03-19T06:07:53.415 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:53.415 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:39.432640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4279,"mds_1":4264,"mds_2":4242,"mds_3":4241,"mds_4":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"a","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":2,"incarnation":15,"state":"up:active","state_seq":19,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:active","state_seq":18,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:07:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-03-19T06:07:53.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 msgr2=0x7f23e806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 0x7f23e806e110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0012e0 tx=0x7f23fc009040 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 msgr2=0x7f240c06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009890 tx=0x7f23f40046c0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 shutdown_connections 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f23e806bc50 0x7f23e806e110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f240c15dc60 0x7f240c0c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f240c159c10 0x7f240c06be10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 --2- 172.21.15.17:0/3735529741 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f240c0c9410 0x7f240c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 >> 172.21.15.17:0/3735529741 conn(0x7f240c072360 msgr2=0x7f240c1594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 shutdown_connections 2024-03-19T06:07:53.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.428+0000 7f2412400640 1 -- 172.21.15.17:0/3735529741 wait complete. 2024-03-19T06:07:53.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:07:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.667+0000 7febeaa00640 1 Processor -- start 2024-03-19T06:07:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.667+0000 7febeaa00640 1 -- start start 2024-03-19T06:07:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.669+0000 7febeaa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7febe40afee0 0x7febe40c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.669+0000 7febeaa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe40c7f70 0x7febe4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.669+0000 7febeaa00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe406f6e0 con 0x7febe406dc70 2024-03-19T06:07:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.669+0000 7febeaa00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe40c9e50 con 0x7febe40afee0 2024-03-19T06:07:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.669+0000 7febeaa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe406f9c0 con 0x7febe40c7f70 2024-03-19T06:07:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.670+0000 7febe3400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7febe406dc70 0x7febe406bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:33262/0 (socket says 172.21.15.17:33262) 2024-03-19T06:07:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.670+0000 7febe3400640 1 -- 172.21.15.17:0/934684812 learned_addr learned my addr 172.21.15.17:0/934684812 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:53.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.672+0000 7febe3e00640 1 --2- 172.21.15.17:0/934684812 >> v2:172.21.15.17:3300/0 conn(0x7febe40afee0 0x7febe40c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:53.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.673+0000 7febe8a00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe40c7f70 0x7febe4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.678+0000 7febe3e00640 1 -- 172.21.15.17:0/934684812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe40c7f70 msgr2=0x7febe4159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.678+0000 7febe3e00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe40c7f70 0x7febe4159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.678+0000 7febe3e00640 1 -- 172.21.15.17:0/934684812 >> v1:172.21.15.153:6789/0 conn(0x7febe406dc70 legacy=0x7febe406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.678+0000 7febe3e00640 1 -- 172.21.15.17:0/934684812 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40c9890 con 0x7febe40afee0 2024-03-19T06:07:53.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.761+0000 7febe3e00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe40c8c50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7febd40097a0 tx=0x7febd402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf788ea40a0c3d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:53.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.778+0000 7febe2a00640 1 -- 172.21.15.17:0/934684812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4034070 con 0x7febe40afee0 2024-03-19T06:07:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.778+0000 7febe2a00640 1 -- 172.21.15.17:0/934684812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4030610 con 0x7febe40afee0 2024-03-19T06:07:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.778+0000 7febe2a00640 1 -- 172.21.15.17:0/934684812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40309e0 con 0x7febe40afee0 2024-03-19T06:07:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.779+0000 7febeaa00640 1 -- 172.21.15.17:0/934684812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 msgr2=0x7febe40c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.779+0000 7febeaa00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe40c8c50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7febd40097a0 tx=0x7febd402b960 comp rx=0 tx=0).stop 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 -- 172.21.15.17:0/934684812 shutdown_connections 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe40c7f70 0x7febe4159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 --2- 172.21.15.17:0/934684812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe40c8c50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 -- 172.21.15.17:0/934684812 >> 172.21.15.17:0/934684812 conn(0x7febe406b260 msgr2=0x7febe4066a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 -- 172.21.15.17:0/934684812 shutdown_connections 2024-03-19T06:07:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.780+0000 7febeaa00640 1 -- 172.21.15.17:0/934684812 wait complete. 2024-03-19T06:07:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.783+0000 7febeaa00640 1 Processor -- start 2024-03-19T06:07:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.783+0000 7febeaa00640 1 -- start start 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe406dc70 0x7febe4157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe40c7f70 0x7febe41efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe406c450 con 0x7febe40afee0 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b02c0 con 0x7febe40c7f70 2024-03-19T06:07:53.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febeaa00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe406c5d0 con 0x7febe406dc70 2024-03-19T06:07:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.785+0000 7febe3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.786+0000 7febe3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56898/0 (socket says 172.21.15.17:56898) 2024-03-19T06:07:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.786+0000 7febe3400640 1 -- 172.21.15.17:0/2647475412 learned_addr learned my addr 172.21.15.17:0/2647475412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:53.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.790+0000 7febe3400640 1 -- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe406dc70 msgr2=0x7febe4157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.790+0000 7febe3400640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe406dc70 0x7febe4157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.790+0000 7febe3400640 1 -- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe40c7f70 msgr2=0x7febe41efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:53.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.790+0000 7febe3400640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe40c7f70 0x7febe41efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:53.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.790+0000 7febe3400640 1 -- 172.21.15.17:0/2647475412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4158190 con 0x7febe40afee0 2024-03-19T06:07:53.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.793+0000 7febe3400640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7febd000c440 tx=0x7febd0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.798+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0017070 con 0x7febe40afee0 2024-03-19T06:07:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.798+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0005ce0 con 0x7febe40afee0 2024-03-19T06:07:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.798+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4159ba0 con 0x7febe40afee0 2024-03-19T06:07:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.798+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00072f0 con 0x7febe40afee0 2024-03-19T06:07:53.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.798+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe415a160 con 0x7febe40afee0 2024-03-19T06:07:53.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:53.800+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe406b8d0 con 0x7febe40afee0 2024-03-19T06:07:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.125+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7febd001a070 con 0x7febe40afee0 2024-03-19T06:07:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.127+0000 7febdbe00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 0x7febc406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.128+0000 7febe3e00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 0x7febc406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.130+0000 7febe3e00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 0x7febc406e0e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7febd4036000 tx=0x7febd4030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:54.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.171+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7febd00566f0 con 0x7febe40afee0 2024-03-19T06:07:54.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.173+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7febe406b8d0 con 0x7febe40afee0 2024-03-19T06:07:54.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.391+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febe4069be0 con 0x7febe40afee0 2024-03-19T06:07:54.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.442+0000 7febdbe00640 1 -- 172.21.15.17:0/2647475412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7febd0021020 con 0x7febe40afee0 2024-03-19T06:07:54.434 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:54.434 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:07:54.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.446+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 msgr2=0x7febc406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.446+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 0x7febc406e0e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7febd4036000 tx=0x7febd4030000 comp rx=0 tx=0).stop 2024-03-19T06:07:54.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.446+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 msgr2=0x7febe415c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.446+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7febd000c440 tx=0x7febd0001e70 comp rx=0 tx=0).stop 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 shutdown_connections 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7febc406bc20 0x7febc406e0e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe40c7f70 0x7febe41efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febe40afee0 0x7febe415c3d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 --2- 172.21.15.17:0/2647475412 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7febe406dc70 0x7febe4157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 >> 172.21.15.17:0/2647475412 conn(0x7febe406b260 msgr2=0x7febe406bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 shutdown_connections 2024-03-19T06:07:54.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.447+0000 7febeaa00640 1 -- 172.21.15.17:0/2647475412 wait complete. 2024-03-19T06:07:54.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:07:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.669+0000 7f66cc800640 1 Processor -- start 2024-03-19T06:07:54.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.669+0000 7f66cc800640 1 -- start start 2024-03-19T06:07:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.671+0000 7f66cc800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f66c406b510 0x7f66c40c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.671+0000 7f66cc800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66c40c6020 0x7f66c415b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.671+0000 7f66cc800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c4072f90 con 0x7f66c4151e20 2024-03-19T06:07:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.671+0000 7f66cc800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c406f750 con 0x7f66c406b510 2024-03-19T06:07:54.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.671+0000 7f66cc800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c4070720 con 0x7f66c40c6020 2024-03-19T06:07:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.672+0000 7f66c9400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f66c406b510 0x7f66c40c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.672+0000 7f66c9400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f66c406b510 0x7f66c40c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56912/0 (socket says 172.21.15.17:56912) 2024-03-19T06:07:54.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.672+0000 7f66c9400640 1 -- 172.21.15.17:0/2223686255 learned_addr learned my addr 172.21.15.17:0/2223686255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:54.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.674+0000 7f66ca800640 1 --2- 172.21.15.17:0/2223686255 >> v2:172.21.15.153:3300/0 conn(0x7f66c40c6020 0x7f66c415b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.676+0000 7f66c9400640 1 -- 172.21.15.17:0/2223686255 >> v2:172.21.15.153:3300/0 conn(0x7f66c40c6020 msgr2=0x7f66c415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.676+0000 7f66c9400640 1 --2- 172.21.15.17:0/2223686255 >> v2:172.21.15.153:3300/0 conn(0x7f66c40c6020 0x7f66c415b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.676+0000 7f66c9400640 1 -- 172.21.15.17:0/2223686255 >> v1:172.21.15.153:6789/0 conn(0x7f66c4151e20 legacy=0x7f66c4072880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.676+0000 7f66c9400640 1 -- 172.21.15.17:0/2223686255 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c4152200 con 0x7f66c406b510 2024-03-19T06:07:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.679+0000 7f66c9400640 1 --2- 172.21.15.17:0/2223686255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c406b510 0x7f66c40c5ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66c40c8b60 tx=0x7f66b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead4eb9bd620b21c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.688+0000 7f66c8a00640 1 -- 172.21.15.17:0/2223686255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8034070 con 0x7f66c406b510 2024-03-19T06:07:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.689+0000 7f66c8a00640 1 -- 172.21.15.17:0/2223686255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b8030860 con 0x7f66c406b510 2024-03-19T06:07:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.689+0000 7f66c8a00640 1 -- 172.21.15.17:0/2223686255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8030c30 con 0x7f66c406b510 2024-03-19T06:07:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 -- 172.21.15.17:0/2223686255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c406b510 msgr2=0x7f66c40c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 --2- 172.21.15.17:0/2223686255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c406b510 0x7f66c40c5ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f66c40c8b60 tx=0x7f66b802b9a0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 -- 172.21.15.17:0/2223686255 shutdown_connections 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 --2- 172.21.15.17:0/2223686255 >> v2:172.21.15.153:3300/0 conn(0x7f66c40c6020 0x7f66c415b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 --2- 172.21.15.17:0/2223686255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c406b510 0x7f66c40c5ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 -- 172.21.15.17:0/2223686255 >> 172.21.15.17:0/2223686255 conn(0x7f66c40670b0 msgr2=0x7f66c40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 -- 172.21.15.17:0/2223686255 shutdown_connections 2024-03-19T06:07:54.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.690+0000 7f66cc800640 1 -- 172.21.15.17:0/2223686255 wait complete. 2024-03-19T06:07:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.692+0000 7f66cc800640 1 Processor -- start 2024-03-19T06:07:54.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.693+0000 7f66cc800640 1 -- start start 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.693+0000 7f66cc800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 0x7f66c4146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.694+0000 7f66cc800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40c6020 0x7f66c415a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.694+0000 7f66cc800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 0x7f66c415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.694+0000 7f66cc800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c406ffd0 con 0x7f66c4151e20 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.694+0000 7f66cc800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c406fcf0 con 0x7f66c40c6020 2024-03-19T06:07:54.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.694+0000 7f66cc800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c40702b0 con 0x7f66c406b510 2024-03-19T06:07:54.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.696+0000 7f66c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 0x7f66c4146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.697+0000 7f66c9400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40c6020 0x7f66c415a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.697+0000 7f66ca800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 0x7f66c415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:54.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.697+0000 7f66c9e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 0x7f66c4146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:55866/0 (socket says 172.21.15.17:55866) 2024-03-19T06:07:54.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.697+0000 7f66c9e00640 1 -- 172.21.15.17:0/1331633337 learned_addr learned my addr 172.21.15.17:0/1331633337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:54.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.708+0000 7f66ca800640 1 -- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 msgr2=0x7f66c4146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.708+0000 7f66ca800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 0x7f66c4146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.708+0000 7f66ca800640 1 -- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40c6020 msgr2=0x7f66c415a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:54.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.708+0000 7f66ca800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40c6020 0x7f66c415a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:54.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.708+0000 7f66ca800640 1 -- 172.21.15.17:0/1331633337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c41f1450 con 0x7f66c4151e20 2024-03-19T06:07:54.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.711+0000 7f66ca800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 0x7f66c415abd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66c000cce0 tx=0x7f66c000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:54.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.782+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0003b90 con 0x7f66c4151e20 2024-03-19T06:07:54.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.782+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0003d30 con 0x7f66c4151e20 2024-03-19T06:07:54.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.782+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0004240 con 0x7f66c4151e20 2024-03-19T06:07:54.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.782+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c41f1710 con 0x7f66c4151e20 2024-03-19T06:07:54.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.783+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c41f1cd0 con 0x7f66c4151e20 2024-03-19T06:07:54.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:54.785+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c4158460 con 0x7f66c4151e20 2024-03-19T06:07:55.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.111+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f66c00043e0 con 0x7f66c4151e20 2024-03-19T06:07:55.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.115+0000 7f66be000640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 0x7f66a406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:55.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.115+0000 7f66c9e00640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 0x7f66a406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:55.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.117+0000 7f66c9e00640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 0x7f66a406e0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66b00017a0 tx=0x7f66b0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.152+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f66c0057d20 con 0x7f66c4151e20 2024-03-19T06:07:55.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.153+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f66c4158460 con 0x7f66c4151e20 2024-03-19T06:07:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.423+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66c4069be0 con 0x7f66c4151e20 2024-03-19T06:07:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.466+0000 7f66be000640 1 -- 172.21.15.17:0/1331633337 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6584 (secure 0 0 0) 0x7f66c0059c80 con 0x7f66c4151e20 2024-03-19T06:07:55.457 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:07:55.457 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:39.432640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4279,"mds_1":4264,"mds_2":4242,"mds_3":4241,"mds_4":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"a","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":2,"incarnation":15,"state":"up:active","state_seq":19,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:active","state_seq":18,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:07:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 msgr2=0x7f66a406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 0x7f66a406e0e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f66b00017a0 tx=0x7f66b0009040 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 msgr2=0x7f66c415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 0x7f66c415abd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66c000cce0 tx=0x7f66c000a660 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 shutdown_connections 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c4151e20 0x7f66c415abd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f66a406bc20 0x7f66a406e0e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66c40c6020 0x7f66c415a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 --2- 172.21.15.17:0/1331633337 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f66c406b510 0x7f66c4146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 >> 172.21.15.17:0/1331633337 conn(0x7f66c40670b0 msgr2=0x7f66c4073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 shutdown_connections 2024-03-19T06:07:55.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:55.469+0000 7f66cc800640 1 -- 172.21.15.17:0/1331633337 wait complete. 2024-03-19T06:07:56.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-19T06:06:34.436434+0000', 'modified': '2024-03-19T06:07:39.432640+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4279, 'mds_1': 4264, 'mds_2': 4242, 'mds_3': 4241, 'mds_4': 4235}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4235': {'gid': 4235, 'name': 'b', 'rank': 4, 'incarnation': 19, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.153:6837/1865535875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 1865535875}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1865535875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4241': {'gid': 4241, 'name': 'a', 'rank': 3, 'incarnation': 17, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.17:6837/3549659421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6836', 'nonce': 3549659421}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 3549659421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4242': {'gid': 4242, 'name': 'e', 'rank': 2, 'incarnation': 15, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.17:6835/191121570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6834', 'nonce': 191121570}, {'type': 'v1', 'addr': '172.21.15.17:6835', 'nonce': 191121570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4264': {'gid': 4264, 'name': 'd', 'rank': 1, 'incarnation': 11, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.153:6833/578472937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 578472937}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 578472937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4279': {'gid': 4279, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.17:6839/3325197099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6838', 'nonce': 3325197099}, {'type': 'v1', 'addr': '172.21.15.17:6839', 'nonce': 3325197099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-19T06:07:56.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-19T06:07:56.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-19T06:07:56.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.323+0000 7fb77c400640 1 Processor -- start 2024-03-19T06:07:56.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.324+0000 7fb77c400640 1 -- start start 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.325+0000 7fb77c400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb77415ae50 0x7fb774156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.325+0000 7fb77c400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb774157650 con 0x7fb7740c72d0 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.325+0000 7fb77c400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb774157930 con 0x7fb774150dc0 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.325+0000 7fb77c400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77415a120 con 0x7fb77415ae50 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.326+0000 7fb77a400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb7740c72d0 0x7fb77406e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41906/0 (socket says 172.21.15.17:41906) 2024-03-19T06:07:56.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.326+0000 7fb77a400640 1 -- 172.21.15.17:0/1198145794 learned_addr learned my addr 172.21.15.17:0/1198145794 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.328+0000 7fb779000640 1 --2- 172.21.15.17:0/1198145794 >> v2:172.21.15.153:3300/0 conn(0x7fb77415ae50 0x7fb774156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.329+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694925176 0 0) 0x7fb774157650 con 0x7fb7740c72d0 2024-03-19T06:07:56.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.329+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb75c003520 con 0x7fb7740c72d0 2024-03-19T06:07:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152800099 0 0) 0x7fb75c003520 con 0x7fb7740c72d0 2024-03-19T06:07:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 >> v2:172.21.15.153:3300/0 conn(0x7fb77415ae50 msgr2=0x7fb774156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 --2- 172.21.15.17:0/1198145794 >> v2:172.21.15.153:3300/0 conn(0x7fb77415ae50 0x7fb774156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 >> v1:172.21.15.153:6789/0 conn(0x7fb774150dc0 legacy=0x7fb7740c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77415a370 con 0x7fb7740c72d0 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fb76c0019f0 con 0x7fb7740c72d0 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 >> v1:172.21.15.17:6789/0 conn(0x7fb7740c72d0 legacy=0x7fb77406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.333+0000 7fb773e00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 0x7fb75c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.334+0000 7fb773e00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c004800 0x7fb75c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.334+0000 7fb773e00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb75c005230 0x7fb75c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.334+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415a120 con 0x7fb75c003a00 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.334+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c00c190 con 0x7fb75c005230 2024-03-19T06:07:56.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.334+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c00c390 con 0x7fb75c004800 2024-03-19T06:07:56.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.335+0000 7fb779000640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c004800 0x7fb75c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.337+0000 7fb779a00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 0x7fb75c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb779a00640 1 -- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c004800 msgr2=0x7fb75c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb779a00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c004800 0x7fb75c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb779a00640 1 -- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb75c005230 msgr2=0x7fb75c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb779a00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb75c005230 0x7fb75c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb779a00640 1 -- 172.21.15.17:0/1198145794 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c003520 con 0x7fb75c003a00 2024-03-19T06:07:56.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.341+0000 7fb77a400640 1 -- 172.21.15.17:0/1198145794 reap_dead start 2024-03-19T06:07:56.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.346+0000 7fb779a00640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 0x7fb75c003e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb768001750 tx=0x7fb75c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e8300be7b780b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.353+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768001370 con 0x7fb75c003a00 2024-03-19T06:07:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.353+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680052d0 con 0x7fb75c003a00 2024-03-19T06:07:56.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.353+0000 7fb773e00640 1 -- 172.21.15.17:0/1198145794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768003830 con 0x7fb75c003a00 2024-03-19T06:07:56.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 -- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 msgr2=0x7fb75c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 0x7fb75c003e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb768001750 tx=0x7fb75c005830 comp rx=0 tx=0).stop 2024-03-19T06:07:56.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 -- 172.21.15.17:0/1198145794 shutdown_connections 2024-03-19T06:07:56.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 --2- 172.21.15.17:0/1198145794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb75c003a00 0x7fb75c003e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 -- 172.21.15.17:0/1198145794 >> 172.21.15.17:0/1198145794 conn(0x7fb7740c8910 msgr2=0x7fb7740cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 -- 172.21.15.17:0/1198145794 shutdown_connections 2024-03-19T06:07:56.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.354+0000 7fb77c400640 1 -- 172.21.15.17:0/1198145794 wait complete. 2024-03-19T06:07:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.357+0000 7fb77c400640 1 Processor -- start 2024-03-19T06:07:56.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.357+0000 7fb77c400640 1 -- start start 2024-03-19T06:07:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c003a00 0x7fb774153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7741f0510 0x7fb7741f0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741511a0 con 0x7fb774156810 2024-03-19T06:07:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77415a930 con 0x7fb7741f0510 2024-03-19T06:07:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.358+0000 7fb77c400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c46a0 con 0x7fb75c003a00 2024-03-19T06:07:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.359+0000 7fb779000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.359+0000 7fb779000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56930/0 (socket says 172.21.15.17:56930) 2024-03-19T06:07:56.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.359+0000 7fb779000640 1 -- 172.21.15.17:0/2578662440 learned_addr learned my addr 172.21.15.17:0/2578662440 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.360+0000 7fb779a00640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c003a00 0x7fb774153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.361+0000 7fb77a400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7741f0510 0x7fb7741f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.364+0000 7fb779000640 1 -- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c003a00 msgr2=0x7fb774153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.364+0000 7fb779000640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c003a00 0x7fb774153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.364+0000 7fb779000640 1 -- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7741f0510 msgr2=0x7fb7741f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.364+0000 7fb779000640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7741f0510 0x7fb7741f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.364+0000 7fb779000640 1 -- 172.21.15.17:0/2578662440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774157e90 con 0x7fb774156810 2024-03-19T06:07:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.367+0000 7fb779000640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb760011a70 tx=0x7fb760011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.372+0000 7fb771600640 1 -- 172.21.15.17:0/2578662440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76000fb50 con 0x7fb774156810 2024-03-19T06:07:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.372+0000 7fb771600640 1 -- 172.21.15.17:0/2578662440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76000fcf0 con 0x7fb774156810 2024-03-19T06:07:56.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.372+0000 7fb771600640 1 -- 172.21.15.17:0/2578662440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76000fea0 con 0x7fb774156810 2024-03-19T06:07:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.372+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774158170 con 0x7fb774156810 2024-03-19T06:07:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.372+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77414cfa0 con 0x7fb774156810 2024-03-19T06:07:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.378+0000 7fb77efed740 1 Processor -- start 2024-03-19T06:07:56.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.378+0000 7fb77efed740 1 -- start start 2024-03-19T06:07:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46b00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46afeaa0 0x562d46b3f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46a646f0 con 0x562d46b00040 2024-03-19T06:07:56.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46a0d9e0 con 0x562d46b49ec0 2024-03-19T06:07:56.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.380+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d46a60790 con 0x562d46afeaa0 2024-03-19T06:07:56.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.382+0000 7fb779a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.382+0000 7fb779000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46afeaa0 0x562d46b3f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.383+0000 7fb779a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:35878/0 (socket says 172.21.15.17:35878) 2024-03-19T06:07:56.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.383+0000 7fb779a00640 1 -- 172.21.15.17:0/887342473 learned_addr learned my addr 172.21.15.17:0/887342473 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:56.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.389+0000 7fb779a00640 1 -- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46afeaa0 msgr2=0x562d46b3f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.389+0000 7fb779a00640 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46afeaa0 0x562d46b3f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.389+0000 7fb779a00640 1 -- 172.21.15.17:0/887342473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 msgr2=0x562d46b00420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.389+0000 7fb779a00640 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46b00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.389+0000 7fb779a00640 1 -- 172.21.15.17:0/887342473 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d46a01720 con 0x562d46b49ec0 2024-03-19T06:07:56.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.395+0000 7fb779a00640 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb768001750 tx=0x7fb76802f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3ddcc4d7dab7c97 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.401+0000 7fb771600640 1 -- 172.21.15.17:0/2578662440 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb760012040 con 0x7fb774156810 2024-03-19T06:07:56.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.402+0000 7fb771600640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 0x7fb75406e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.402+0000 7fb77a400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 0x7fb75406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.403+0000 7fb771600640 1 -- 172.21.15.17:0/2578662440 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb760057780 con 0x7fb774156810 2024-03-19T06:07:56.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.403+0000 7fb77a400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 0x7fb75406e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cc040 tx=0x7fb76c007bb0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.405+0000 7fb766000640 1 -- 172.21.15.17:0/887342473 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768042070 con 0x562d46b49ec0 2024-03-19T06:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.406+0000 7fb766000640 1 -- 172.21.15.17:0/887342473 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680052d0 con 0x562d46b49ec0 2024-03-19T06:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.406+0000 7fb766000640 1 -- 172.21.15.17:0/887342473 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768007280 con 0x562d46b49ec0 2024-03-19T06:07:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.406+0000 7fb77efed740 1 -- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 msgr2=0x562d46b00960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.406+0000 7fb77efed740 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb768001750 tx=0x7fb76802f000 comp rx=0 tx=0).stop 2024-03-19T06:07:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 -- 172.21.15.17:0/887342473 shutdown_connections 2024-03-19T06:07:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46afeaa0 0x562d46b3f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b00960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 --2- 172.21.15.17:0/887342473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46b00420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 -- 172.21.15.17:0/887342473 >> 172.21.15.17:0/887342473 conn(0x562d46afc7b0 msgr2=0x562d46aff0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 -- 172.21.15.17:0/887342473 shutdown_connections 2024-03-19T06:07:56.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.407+0000 7fb77efed740 1 -- 172.21.15.17:0/887342473 wait complete. 2024-03-19T06:07:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.408+0000 7fb77efed740 1 -- start start 2024-03-19T06:07:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.408+0000 7fb77efed740 1 Processor -- start 2024-03-19T06:07:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b3fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46b1ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46b255a0 con 0x562d46b49ec0 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46a20e20 con 0x562d46b41ea0 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d46afd960 con 0x562d46b00040 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.409+0000 7fb77efed740 10 client.0 _ll_register_callbacks cb 0x562d46a5b8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.410+0000 7fb779000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.410+0000 7fb779000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56952/0 (socket says 172.21.15.17:56952) 2024-03-19T06:07:56.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.410+0000 7fb779000640 1 -- 172.21.15.17:0/1925957898 learned_addr learned my addr 172.21.15.17:0/1925957898 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:56.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.411+0000 7fb779a00640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b3fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.412+0000 7fb77a400640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46b1ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.414+0000 7fb779000640 1 -- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 msgr2=0x562d46b3fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.414+0000 7fb779000640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b3fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.414+0000 7fb779000640 1 -- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 msgr2=0x562d46b1ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.414+0000 7fb779000640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46b1ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.414+0000 7fb779000640 1 -- 172.21.15.17:0/1925957898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d467792d0 con 0x562d46b49ec0 2024-03-19T06:07:56.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.417+0000 7fb779000640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb760056060 tx=0x7fb760059cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10fa8fa3239f3c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.417+0000 7fb75aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.422+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760061df0 con 0x562d46b49ec0 2024-03-19T06:07:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.422+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb760055430 con 0x562d46b49ec0 2024-03-19T06:07:56.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.422+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7680052d0 con 0x562d46b49ec0 2024-03-19T06:07:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.425+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb760089050 con 0x562d46b49ec0 2024-03-19T06:07:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.425+0000 7fb77efed740 10 client.4668 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:56.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.425+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x562d468436b0 con 0x562d46b49ec0 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760084020 con 0x562d46b49ec0 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fb760025030 con 0x562d46b49ec0 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 10 client.4668 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 20 client.4668 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b5dc00 0x562d46b5fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 4 client.4668 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:07:56.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.432+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 --> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d46a71c30 con 0x562d46b5dc00 2024-03-19T06:07:56.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.435+0000 7fb779a00640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b5dc00 0x562d46b5fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.530+0000 7fb779a00640 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b5dc00 0x562d46b5fff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=902d3270cde8ae server_cookie=c250cae48330eb5c in_seq=0 out_seq=0 2024-03-19T06:07:56.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.530+0000 7fb75aa00640 10 client.4668 ms_handle_connect on v2:172.21.15.153:6836/1865535875 2024-03-19T06:07:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.709+0000 7fb75aa00640 1 -- 172.21.15.17:0/1925957898 <== mds.4 v2:172.21.15.153:6836/1865535875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d46a71c30 con 0x562d46b5dc00 2024-03-19T06:07:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.709+0000 7fb75aa00640 10 client.4668 handle_command_reply: tid=0 2024-03-19T06:07:56.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.710+0000 7fb77efed740 1 client.4668 shutdown 2024-03-19T06:07:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.710+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 msgr2=0x562d46b43d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.710+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb760056060 tx=0x7fb760059cb0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 shutdown_connections 2024-03-19T06:07:56.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b5dc00 0x562d46b5fff0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46b1ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46b43d30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 --2- 172.21.15.17:0/1925957898 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b3fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb75aa00640 0 client.4668 ms_handle_reset on v2:172.21.15.153:6836/1865535875 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 >> 172.21.15.17:0/1925957898 conn(0x562d46afeaa0 msgr2=0x562d46b41050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 shutdown_connections 2024-03-19T06:07:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.711+0000 7fb77efed740 1 -- 172.21.15.17:0/1925957898 wait complete. 2024-03-19T06:07:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.712+0000 7fb77efed740 20 client.4668 trim_cache size 0 max 16384 2024-03-19T06:07:56.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.762+0000 7fb77efed740 1 Processor -- start 2024-03-19T06:07:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.762+0000 7fb77efed740 1 -- start start 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b41ea0 0x562d46af9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b48f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741f4640 con 0x562d46b00040 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46b44b00 con 0x562d46b49ec0 2024-03-19T06:07:56.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.764+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d46b24320 con 0x562d46b41ea0 2024-03-19T06:07:56.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.766+0000 7fb779a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.766+0000 7fb779a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56956/0 (socket says 172.21.15.17:56956) 2024-03-19T06:07:56.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.766+0000 7fb779a00640 1 -- 172.21.15.17:0/3165142725 learned_addr learned my addr 172.21.15.17:0/3165142725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:56.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.766+0000 7fb77a400640 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b48f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.767+0000 7fb779000640 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b41ea0 0x562d46af9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.772+0000 7fb779a00640 1 -- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b41ea0 msgr2=0x562d46af9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.772+0000 7fb779a00640 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b41ea0 0x562d46af9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.772+0000 7fb779a00640 1 -- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 msgr2=0x562d46b48f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.772+0000 7fb779a00640 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b48f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.772+0000 7fb779a00640 1 -- 172.21.15.17:0/3165142725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d46b5b700 con 0x562d46b00040 2024-03-19T06:07:56.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.776+0000 7fb779a00640 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb768003830 tx=0x7fb768007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6ee208d5bb53ca server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.785+0000 7fb765600640 1 -- 172.21.15.17:0/3165142725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768042040 con 0x562d46b00040 2024-03-19T06:07:56.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.785+0000 7fb765600640 1 -- 172.21.15.17:0/3165142725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768051610 con 0x562d46b00040 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.785+0000 7fb765600640 1 -- 172.21.15.17:0/3165142725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768003890 con 0x562d46b00040 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 -- 172.21.15.17:0/3165142725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 msgr2=0x562d46af95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb768003830 tx=0x7fb768007c80 comp rx=0 tx=0).stop 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 -- 172.21.15.17:0/3165142725 shutdown_connections 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b49ec0 0x562d46b48f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b41ea0 0x562d46af9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 --2- 172.21.15.17:0/3165142725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b00040 0x562d46af95a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 -- 172.21.15.17:0/3165142725 >> 172.21.15.17:0/3165142725 conn(0x562d46afeaa0 msgr2=0x562d46b3a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 -- 172.21.15.17:0/3165142725 shutdown_connections 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.786+0000 7fb77efed740 1 -- 172.21.15.17:0/3165142725 wait complete. 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.787+0000 7fb77efed740 1 -- start start 2024-03-19T06:07:56.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.788+0000 7fb77efed740 1 Processor -- start 2024-03-19T06:07:56.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b49320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46ba62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46b1d670 con 0x562d46b49ec0 2024-03-19T06:07:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d46b23400 con 0x562d46b41ea0 2024-03-19T06:07:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d46b18620 con 0x562d46b00040 2024-03-19T06:07:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.790+0000 7fb77efed740 10 client.0 _ll_register_callbacks cb 0x7fb75c00c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:56.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.791+0000 7fb77a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.791+0000 7fb77a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56972/0 (socket says 172.21.15.17:56972) 2024-03-19T06:07:56.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.791+0000 7fb77a400640 1 -- 172.21.15.17:0/2540066461 learned_addr learned my addr 172.21.15.17:0/2540066461 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:56.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.792+0000 7fb779a00640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b49320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.792+0000 7fb779000640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46ba62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.795+0000 7fb77a400640 1 -- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 msgr2=0x562d46b49320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.795+0000 7fb77a400640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b49320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.796+0000 7fb77a400640 1 -- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 msgr2=0x562d46ba62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:56.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.796+0000 7fb77a400640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46ba62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.796+0000 7fb77a400640 1 -- 172.21.15.17:0/2540066461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d46b64a20 con 0x562d46b49ec0 2024-03-19T06:07:56.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.798+0000 7fb77a400640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7740719e0 tx=0x7fb76c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d84ce7b3e0da49a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:56.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.798+0000 7fb75aa00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:56.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.804+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0128a0 con 0x562d46b49ec0 2024-03-19T06:07:56.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.804+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb76c010040 con 0x562d46b49ec0 2024-03-19T06:07:56.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.804+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb768051610 con 0x562d46b49ec0 2024-03-19T06:07:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.807+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb76c012a40 con 0x562d46b49ec0 2024-03-19T06:07:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.807+0000 7fb77efed740 10 client.4674 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.807+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x562d46b21b30 con 0x562d46b49ec0 2024-03-19T06:07:56.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.815+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768051610 con 0x562d46b49ec0 2024-03-19T06:07:56.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.815+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fb76c012be0 con 0x562d46b49ec0 2024-03-19T06:07:56.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 10 client.4674 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-19T06:07:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 20 client.4674 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b20140 0x562d46bb8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 4 client.4674 mds_command: new command op to 4235 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:07:56.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.816+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 --> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d46b1c540 con 0x562d46b20140 2024-03-19T06:07:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.818+0000 7fb779a00640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b20140 0x562d46bb8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:56.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.829+0000 7fb779a00640 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b20140 0x562d46bb8de0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3145161b1848eaa4 server_cookie=2e8ed00489bb21db in_seq=0 out_seq=0 2024-03-19T06:07:56.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.829+0000 7fb75aa00640 10 client.4674 ms_handle_connect on v2:172.21.15.153:6836/1865535875 2024-03-19T06:07:56.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb75aa00640 1 -- 172.21.15.17:0/2540066461 <== mds.4 v2:172.21.15.153:6836/1865535875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x562d46b1c540 con 0x562d46b20140 2024-03-19T06:07:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb75aa00640 10 client.4674 handle_command_reply: tid=0 2024-03-19T06:07:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 client.4674 shutdown 2024-03-19T06:07:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 msgr2=0x562d46ba6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7740719e0 tx=0x7fb76c012000 comp rx=0 tx=0).stop 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 shutdown_connections 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:6836/1865535875,v1:172.21.15.153:6837/1865535875] conn(0x562d46b20140 0x562d46bb8de0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x562d46b49ec0 0x562d46ba6800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562d46b41ea0 0x562d46ba62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 --2- 172.21.15.17:0/2540066461 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x562d46b00040 0x562d46b49320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb75aa00640 0 client.4674 ms_handle_reset on v2:172.21.15.153:6836/1865535875 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.869+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 >> 172.21.15.17:0/2540066461 conn(0x562d46afeaa0 msgr2=0x562d46b17b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.870+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 shutdown_connections 2024-03-19T06:07:56.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.870+0000 7fb77efed740 1 -- 172.21.15.17:0/2540066461 wait complete. 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.870+0000 7fb77efed740 20 client.4674 trim_cache size 0 max 16384 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 4, 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4235, 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:07:56.862 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 19.483763543999999, 2024-03-19T06:07:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 20, 2024-03-19T06:07:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2024-03-19T06:07:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2024-03-19T06:07:56.863 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 95.473888504000001 2024-03-19T06:07:56.863 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 msgr2=0x7fb75406e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 0x7fb75406e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cc040 tx=0x7fb76c007bb0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 msgr2=0x7fb77414eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb760011a70 tx=0x7fb760011f30 comp rx=0 tx=0).stop 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 shutdown_connections 2024-03-19T06:07:56.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb75406bbc0 0x7fb75406e080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7741f0510 0x7fb7741f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb774156810 0x7fb77414eea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 --2- 172.21.15.17:0/2578662440 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb75c003a00 0x7fb774153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.872+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 >> 172.21.15.17:0/2578662440 conn(0x7fb7740c8910 msgr2=0x7fb77406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.873+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 shutdown_connections 2024-03-19T06:07:56.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:56.873+0000 7fb77c400640 1 -- 172.21.15.17:0/2578662440 wait complete. 2024-03-19T06:07:56.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-19T06:07:57.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.119+0000 7f0de6400640 1 Processor -- start 2024-03-19T06:07:57.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.119+0000 7f0de6400640 1 -- start start 2024-03-19T06:07:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.120+0000 7f0de6400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de0151f70 0x7f0de00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.120+0000 7f0de6400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0de00c1e60 0x7f0de006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.120+0000 7f0de6400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de00c27c0 con 0x7f0de015b1d0 2024-03-19T06:07:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.121+0000 7f0de6400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de0157f30 con 0x7f0de00c1e60 2024-03-19T06:07:57.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.121+0000 7f0de6400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de0152350 con 0x7f0de0151f70 2024-03-19T06:07:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.122+0000 7f0ddfe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0de00c1e60 0x7f0de006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.122+0000 7f0dd7e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0de015b1d0 0x7f0de01583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:41920/0 (socket says 172.21.15.17:41920) 2024-03-19T06:07:57.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.122+0000 7f0dd7e00640 1 -- 172.21.15.17:0/1575285162 learned_addr learned my addr 172.21.15.17:0/1575285162 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:07:57.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.123+0000 7f0ddf400640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de0151f70 0x7f0de00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.127+0000 7f0ddfe00640 1 -- 172.21.15.17:0/1575285162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de0151f70 msgr2=0x7f0de00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.127+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de0151f70 0x7f0de00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.127+0000 7f0ddfe00640 1 -- 172.21.15.17:0/1575285162 >> v1:172.21.15.17:6789/0 conn(0x7f0de015b1d0 legacy=0x7f0de01583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.127+0000 7f0ddfe00640 1 -- 172.21.15.17:0/1575285162 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0157be0 con 0x7f0de00c1e60 2024-03-19T06:07:57.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.134+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de00c1e60 0x7f0de006e720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e0131bfc9045f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.140+0000 7f0ddea00640 1 -- 172.21.15.17:0/1575285162 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8039070 con 0x7f0de00c1e60 2024-03-19T06:07:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.140+0000 7f0ddea00640 1 -- 172.21.15.17:0/1575285162 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd802cce0 con 0x7f0de00c1e60 2024-03-19T06:07:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.140+0000 7f0ddea00640 1 -- 172.21.15.17:0/1575285162 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8034660 con 0x7f0de00c1e60 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.141+0000 7f0de6400640 1 -- 172.21.15.17:0/1575285162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de00c1e60 msgr2=0x7f0de006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.141+0000 7f0de6400640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de00c1e60 0x7f0de006e720 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009d90 tx=0x7f0dd802bf30 comp rx=0 tx=0).stop 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 -- 172.21.15.17:0/1575285162 shutdown_connections 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de00c1e60 0x7f0de006e720 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 --2- 172.21.15.17:0/1575285162 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de0151f70 0x7f0de00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 -- 172.21.15.17:0/1575285162 >> 172.21.15.17:0/1575285162 conn(0x7f0de00c8910 msgr2=0x7f0de00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 -- 172.21.15.17:0/1575285162 shutdown_connections 2024-03-19T06:07:57.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.142+0000 7f0de6400640 1 -- 172.21.15.17:0/1575285162 wait complete. 2024-03-19T06:07:57.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.145+0000 7f0de6400640 1 Processor -- start 2024-03-19T06:07:57.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.145+0000 7f0de6400640 1 -- start start 2024-03-19T06:07:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de00c1e60 0x7f0de0152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015b1d0 0x7f0de01eb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015bcf0 con 0x7f0de0151f70 2024-03-19T06:07:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015ba10 con 0x7f0de015b1d0 2024-03-19T06:07:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.147+0000 7f0de6400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de015bfd0 con 0x7f0de00c1e60 2024-03-19T06:07:57.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.148+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.148+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56990/0 (socket says 172.21.15.17:56990) 2024-03-19T06:07:57.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.148+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3969480042 learned_addr learned my addr 172.21.15.17:0/3969480042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:57.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.149+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de00c1e60 0x7f0de0152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.149+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015b1d0 0x7f0de01eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.154+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de00c1e60 msgr2=0x7f0de0152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.154+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de00c1e60 0x7f0de0152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.154+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015b1d0 msgr2=0x7f0de01eb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.154+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015b1d0 0x7f0de01eb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.154+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3969480042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0154de0 con 0x7f0de0151f70 2024-03-19T06:07:57.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.157+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c3f0 tx=0x7f0dc800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.164+0000 7f0dd7400640 1 -- 172.21.15.17:0/3969480042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8017070 con 0x7f0de0151f70 2024-03-19T06:07:57.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.164+0000 7f0dd7400640 1 -- 172.21.15.17:0/3969480042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8005ce0 con 0x7f0de0151f70 2024-03-19T06:07:57.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.164+0000 7f0dd7400640 1 -- 172.21.15.17:0/3969480042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80072f0 con 0x7f0de0151f70 2024-03-19T06:07:57.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.164+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de0152ac0 con 0x7f0de0151f70 2024-03-19T06:07:57.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.165+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de0155360 con 0x7f0de0151f70 2024-03-19T06:07:57.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.170+0000 7f0de91e6740 1 Processor -- start 2024-03-19T06:07:57.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.170+0000 7f0de91e6740 1 -- start start 2024-03-19T06:07:57.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41c8aa0 0x5649a42098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a412e6f0 con 0x5649a4213ec0 2024-03-19T06:07:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a40d79e0 con 0x5649a41ca040 2024-03-19T06:07:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.172+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a412a790 con 0x5649a41c8aa0 2024-03-19T06:07:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.174+0000 7f0ddfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.174+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41c8aa0 0x5649a42098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.175+0000 7f0ddfe00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:35930/0 (socket says 172.21.15.17:35930) 2024-03-19T06:07:57.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.175+0000 7f0ddfe00640 1 -- 172.21.15.17:0/2662335631 learned_addr learned my addr 172.21.15.17:0/2662335631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.181+0000 7f0ddfe00640 1 -- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41c8aa0 msgr2=0x5649a42098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.181+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41c8aa0 0x5649a42098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.181+0000 7f0ddfe00640 1 -- 172.21.15.17:0/2662335631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 msgr2=0x5649a41ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.181+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.181+0000 7f0ddfe00640 1 -- 172.21.15.17:0/2662335631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649a40cb720 con 0x5649a41ca040 2024-03-19T06:07:57.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.187+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009eb0 tx=0x7f0dd802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc3f3d7b66d7a9a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.193+0000 7f0dd7400640 1 -- 172.21.15.17:0/3969480042 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f0dc801a070 con 0x7f0de0151f70 2024-03-19T06:07:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.194+0000 7f0dd7400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 0x7f0dbc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.194+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 0x7f0dbc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.195+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 0x7f0dbc06e110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00096a0 tx=0x7f0dd0009630 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.196+0000 7f0dd7400640 1 -- 172.21.15.17:0/3969480042 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0dc8056710 con 0x7f0de0151f70 2024-03-19T06:07:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.198+0000 7f0dcfe00640 1 -- 172.21.15.17:0/2662335631 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8044070 con 0x5649a41ca040 2024-03-19T06:07:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.198+0000 7f0dcfe00640 1 -- 172.21.15.17:0/2662335631 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd8040460 con 0x5649a41ca040 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.198+0000 7f0dcfe00640 1 -- 172.21.15.17:0/2662335631 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8039040 con 0x5649a41ca040 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.199+0000 7f0de91e6740 1 -- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 msgr2=0x5649a41ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.199+0000 7f0de91e6740 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009eb0 tx=0x7f0dd802e000 comp rx=0 tx=0).stop 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 -- 172.21.15.17:0/2662335631 shutdown_connections 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41c8aa0 0x5649a42098a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 --2- 172.21.15.17:0/2662335631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41ca420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 -- 172.21.15.17:0/2662335631 >> 172.21.15.17:0/2662335631 conn(0x5649a41c67b0 msgr2=0x5649a41c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 -- 172.21.15.17:0/2662335631 shutdown_connections 2024-03-19T06:07:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.200+0000 7f0de91e6740 1 -- 172.21.15.17:0/2662335631 wait complete. 2024-03-19T06:07:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.201+0000 7f0de91e6740 1 -- start start 2024-03-19T06:07:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.201+0000 7f0de91e6740 1 Processor -- start 2024-03-19T06:07:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41f3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a41ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a41ef5a0 con 0x5649a4213ec0 2024-03-19T06:07:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a40eae20 con 0x5649a41ca040 2024-03-19T06:07:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a41c7960 con 0x5649a41ec9b0 2024-03-19T06:07:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.203+0000 7f0de91e6740 10 client.0 _ll_register_callbacks cb 0x5649a41258d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.204+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.204+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57020/0 (socket says 172.21.15.17:57020) 2024-03-19T06:07:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.204+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3692469630 learned_addr learned my addr 172.21.15.17:0/3692469630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.206+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a41ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.206+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.209+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 msgr2=0x5649a41ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.209+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a41ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.209+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 msgr2=0x5649a41f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.209+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.209+0000 7f0dd7e00640 1 -- 172.21.15.17:0/3692469630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649a3e432d0 con 0x5649a4213ec0 2024-03-19T06:07:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.212+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80070a0 tx=0x7f0dc80587b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8a5d6663cd3047 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.212+0000 7f0dccc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:57.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.218+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8060cd0 con 0x5649a4213ec0 2024-03-19T06:07:57.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.218+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0dc8070170 con 0x5649a4213ec0 2024-03-19T06:07:57.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.218+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dd8040460 con 0x5649a4213ec0 2024-03-19T06:07:57.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.220+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc8070370 con 0x5649a4213ec0 2024-03-19T06:07:57.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.220+0000 7f0de91e6740 10 client.4686 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:57.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.220+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5649a3f0d6b0 con 0x5649a4213ec0 2024-03-19T06:07:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.226+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd8040460 con 0x5649a4213ec0 2024-03-19T06:07:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.226+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f0dc80881a0 con 0x5649a4213ec0 2024-03-19T06:07:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.226+0000 7f0de91e6740 10 client.4686 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.226+0000 7f0de91e6740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-19T06:07:57.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.226+0000 7f0de91e6740 20 client.4686 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:57.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.227+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4227e90 0x5649a422a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.227+0000 7f0de91e6740 4 client.4686 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:07:57.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.227+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 --> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649a413bc30 con 0x5649a4227e90 2024-03-19T06:07:57.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.239+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4227e90 0x5649a422a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.389+0000 7f0ddf400640 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4227e90 0x5649a422a280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b2e8bf19d1145039 server_cookie=1927a2038d5cfaf7 in_seq=0 out_seq=0 2024-03-19T06:07:57.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.389+0000 7f0dccc00640 10 client.4686 ms_handle_connect on v2:172.21.15.17:6836/3549659421 2024-03-19T06:07:57.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.624+0000 7f0dccc00640 1 -- 172.21.15.17:0/3692469630 <== mds.3 v2:172.21.15.17:6836/3549659421 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5649a413bc30 con 0x5649a4227e90 2024-03-19T06:07:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.624+0000 7f0dccc00640 10 client.4686 handle_command_reply: tid=0 2024-03-19T06:07:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.624+0000 7f0de91e6740 1 client.4686 shutdown 2024-03-19T06:07:57.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 msgr2=0x5649a41edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80070a0 tx=0x7f0dc80587b0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 shutdown_connections 2024-03-19T06:07:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4227e90 0x5649a422a280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a41ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a4213ec0 0x5649a41edf70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 --2- 172.21.15.17:0/3692469630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a41f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 >> 172.21.15.17:0/3692469630 conn(0x5649a41c8aa0 msgr2=0x5649a4209d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.625+0000 7f0dccc00640 0 client.4686 ms_handle_reset on v2:172.21.15.17:6836/3549659421 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.626+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 shutdown_connections 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.626+0000 7f0de91e6740 1 -- 172.21.15.17:0/3692469630 wait complete. 2024-03-19T06:07:57.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.626+0000 7f0de91e6740 20 client.4686 trim_cache size 0 max 16384 2024-03-19T06:07:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.665+0000 7f0de91e6740 1 Processor -- start 2024-03-19T06:07:57.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.665+0000 7f0de91e6740 1 -- start start 2024-03-19T06:07:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a420e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a4213ec0 0x5649a41c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01f9580 con 0x5649a41ca040 2024-03-19T06:07:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01f7990 con 0x5649a4213ec0 2024-03-19T06:07:57.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.667+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a420faf0 con 0x5649a41ec9b0 2024-03-19T06:07:57.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.669+0000 7f0ddf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.669+0000 7f0ddf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57034/0 (socket says 172.21.15.17:57034) 2024-03-19T06:07:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.669+0000 7f0ddf400640 1 -- 172.21.15.17:0/588547923 learned_addr learned my addr 172.21.15.17:0/588547923 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.669+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a4213ec0 0x5649a41c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.670+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a420e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.673+0000 7f0ddf400640 1 -- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 msgr2=0x5649a420e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.673+0000 7f0ddf400640 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a420e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.673+0000 7f0ddf400640 1 -- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a4213ec0 msgr2=0x5649a41c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.673+0000 7f0ddf400640 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a4213ec0 0x5649a41c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.673+0000 7f0ddf400640 1 -- 172.21.15.17:0/588547923 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649a41f3b70 con 0x5649a41ca040 2024-03-19T06:07:57.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.676+0000 7f0ddf400640 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0011e90 tx=0x7f0dd0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27559ec82f3be4a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.682+0000 7f0dcf400640 1 -- 172.21.15.17:0/588547923 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd002f070 con 0x5649a41ca040 2024-03-19T06:07:57.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.682+0000 7f0dcf400640 1 -- 172.21.15.17:0/588547923 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd001e040 con 0x5649a41ca040 2024-03-19T06:07:57.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.682+0000 7f0dcf400640 1 -- 172.21.15.17:0/588547923 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd001d040 con 0x5649a41ca040 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.683+0000 7f0de91e6740 1 -- 172.21.15.17:0/588547923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 msgr2=0x5649a420deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.683+0000 7f0de91e6740 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0011e90 tx=0x7f0dd0018000 comp rx=0 tx=0).stop 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 -- 172.21.15.17:0/588547923 shutdown_connections 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a4213ec0 0x5649a41c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a41ec9b0 0x5649a420e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 --2- 172.21.15.17:0/588547923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ca040 0x5649a420deb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 -- 172.21.15.17:0/588547923 >> 172.21.15.17:0/588547923 conn(0x5649a41c8aa0 msgr2=0x5649a41c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 -- 172.21.15.17:0/588547923 shutdown_connections 2024-03-19T06:07:57.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.684+0000 7f0de91e6740 1 -- 172.21.15.17:0/588547923 wait complete. 2024-03-19T06:07:57.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.685+0000 7f0de91e6740 1 -- start start 2024-03-19T06:07:57.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.686+0000 7f0de91e6740 1 Processor -- start 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a4207000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a4213ec0 0x5649a41c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a41efeb0 con 0x5649a41ec9b0 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649a41ee4b0 con 0x5649a41ca040 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649a421ec70 con 0x5649a4213ec0 2024-03-19T06:07:57.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.687+0000 7f0de91e6740 10 client.0 _ll_register_callbacks cb 0x7f0dd0009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.688+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.689+0000 7f0dd7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57038/0 (socket says 172.21.15.17:57038) 2024-03-19T06:07:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.689+0000 7f0dd7e00640 1 -- 172.21.15.17:0/349531781 learned_addr learned my addr 172.21.15.17:0/349531781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:57.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.689+0000 7f0ddf400640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a4207000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0ddfe00640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a4213ec0 0x5649a41c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0dd7e00640 1 -- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a4213ec0 msgr2=0x5649a41c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a4213ec0 0x5649a41c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0dd7e00640 1 -- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 msgr2=0x5649a4207000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a4207000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.695+0000 7f0dd7e00640 1 -- 172.21.15.17:0/349531781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649a4207750 con 0x5649a41ec9b0 2024-03-19T06:07:57.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.707+0000 7f0dd7e00640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80607a0 tx=0x7f0dc8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fb5f22a85aed47 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:57.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.707+0000 7f0dccc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:57.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.716+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc807c060 con 0x5649a41ec9b0 2024-03-19T06:07:57.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.716+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0dc8057cd0 con 0x5649a41ec9b0 2024-03-19T06:07:57.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.716+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dd001e040 con 0x5649a41ec9b0 2024-03-19T06:07:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.720+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc8074070 con 0x5649a41ec9b0 2024-03-19T06:07:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.720+0000 7f0de91e6740 10 client.4692 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.720+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5649a4207540 con 0x5649a41ec9b0 2024-03-19T06:07:57.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd001e040 con 0x5649a41ec9b0 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7f0dc80773b0 con 0x5649a41ec9b0 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 10 client.4692 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 20 client.4692 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4211f80 0x5649a4212360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 4 client.4692 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:07:57.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.729+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 --> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649a4135f80 con 0x5649a4211f80 2024-03-19T06:07:57.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.731+0000 7f0ddf400640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4211f80 0x5649a4212360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:57.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.739+0000 7f0dccc00640 10 client.4692 ms_handle_connect on v2:172.21.15.17:6836/3549659421 2024-03-19T06:07:57.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.739+0000 7f0ddf400640 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4211f80 0x5649a4212360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=63671d5e7fd78706 server_cookie=9750d7841ba93ee9 in_seq=0 out_seq=0 2024-03-19T06:07:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.771+0000 7f0dccc00640 1 -- 172.21.15.17:0/349531781 <== mds.3 v2:172.21.15.17:6836/3549659421 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5649a4135f80 con 0x5649a4211f80 2024-03-19T06:07:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.771+0000 7f0dccc00640 10 client.4692 handle_command_reply: tid=0 2024-03-19T06:07:57.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.771+0000 7f0de91e6740 1 client.4692 shutdown 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 msgr2=0x5649a41c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80607a0 tx=0x7f0dc8000bc0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 shutdown_connections 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:6836/3549659421,v1:172.21.15.17:6837/3549659421] conn(0x5649a4211f80 0x5649a4212360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5649a4213ec0 0x5649a41c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x5649a41ec9b0 0x5649a41c90f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 --2- 172.21.15.17:0/349531781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649a41ca040 0x5649a4207000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0dccc00640 0 client.4692 ms_handle_reset on v2:172.21.15.17:6836/3549659421 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 >> 172.21.15.17:0/349531781 conn(0x5649a41c8aa0 msgr2=0x5649a41c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 shutdown_connections 2024-03-19T06:07:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.772+0000 7f0de91e6740 1 -- 172.21.15.17:0/349531781 wait complete. 2024-03-19T06:07:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.773+0000 7f0de91e6740 20 client.4692 trim_cache size 0 max 16384 2024-03-19T06:07:57.765 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:07:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:07:57.765 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 3, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4241, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 24.829438258, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 20, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 96.234264682000003 2024-03-19T06:07:57.766 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:07:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.773+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 msgr2=0x7f0dbc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.773+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 0x7f0dbc06e110 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00096a0 tx=0x7f0dd0009630 comp rx=0 tx=0).stop 2024-03-19T06:07:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 msgr2=0x7f0de0149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c3f0 tx=0x7f0dc800c8b0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 shutdown_connections 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f0dbc06bc50 0x7f0dbc06e110 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de015b1d0 0x7f0de01eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0de0151f70 0x7f0de0149390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 --2- 172.21.15.17:0/3969480042 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f0de00c1e60 0x7f0de0152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 >> 172.21.15.17:0/3969480042 conn(0x7f0de00c8910 msgr2=0x7f0de0156810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 shutdown_connections 2024-03-19T06:07:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:57.774+0000 7f0de6400640 1 -- 172.21.15.17:0/3969480042 wait complete. 2024-03-19T06:07:57.785 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-19T06:07:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.020+0000 7efc70000640 1 Processor -- start 2024-03-19T06:07:58.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.021+0000 7efc70000640 1 -- start start 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efc681541d0 0x7efc680ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc680cb8d0 0x7efc680cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc680cb2d0 0x7efc6815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6815d3b0 con 0x7efc680cb8d0 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6815a0d0 con 0x7efc681541d0 2024-03-19T06:07:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.024+0000 7efc70000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815a3b0 con 0x7efc680cb2d0 2024-03-19T06:07:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.026+0000 7efc6d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efc681541d0 0x7efc680ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.026+0000 7efc6e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc680cb2d0 0x7efc6815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.026+0000 7efc6d600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efc681541d0 0x7efc680ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:35950/0 (socket says 172.21.15.17:35950) 2024-03-19T06:07:58.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.026+0000 7efc6d600640 1 -- 172.21.15.17:0/1491583392 learned_addr learned my addr 172.21.15.17:0/1491583392 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.033+0000 7efc6d600640 1 -- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc680cb2d0 msgr2=0x7efc6815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.033+0000 7efc6d600640 1 --2- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc680cb2d0 0x7efc6815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.033+0000 7efc6d600640 1 -- 172.21.15.17:0/1491583392 >> v2:172.21.15.17:3300/0 conn(0x7efc680cb8d0 msgr2=0x7efc680cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.033+0000 7efc6d600640 1 --2- 172.21.15.17:0/1491583392 >> v2:172.21.15.17:3300/0 conn(0x7efc680cb8d0 0x7efc680cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.033+0000 7efc6d600640 1 -- 172.21.15.17:0/1491583392 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6815a690 con 0x7efc681541d0 2024-03-19T06:07:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.038+0000 7efc6d600640 1 --2- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc681541d0 0x7efc680ca2a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc6808cb70 tx=0x7efc5c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81fc85f34b8c621e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.049+0000 7efc67e00640 1 -- 172.21.15.17:0/1491583392 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c034070 con 0x7efc681541d0 2024-03-19T06:07:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.050+0000 7efc67e00640 1 -- 172.21.15.17:0/1491583392 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c030860 con 0x7efc681541d0 2024-03-19T06:07:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.050+0000 7efc67e00640 1 -- 172.21.15.17:0/1491583392 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c030c30 con 0x7efc681541d0 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 -- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc681541d0 msgr2=0x7efc680ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 --2- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc681541d0 0x7efc680ca2a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efc6808cb70 tx=0x7efc5c02b9a0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 -- 172.21.15.17:0/1491583392 shutdown_connections 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 --2- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc680cb2d0 0x7efc6815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 --2- 172.21.15.17:0/1491583392 >> v2:172.21.15.17:3300/0 conn(0x7efc680cb8d0 0x7efc680cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 --2- 172.21.15.17:0/1491583392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc681541d0 0x7efc680ca2a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 -- 172.21.15.17:0/1491583392 >> 172.21.15.17:0/1491583392 conn(0x7efc6806baf0 msgr2=0x7efc6806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.051+0000 7efc70000640 1 -- 172.21.15.17:0/1491583392 shutdown_connections 2024-03-19T06:07:58.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.052+0000 7efc70000640 1 -- 172.21.15.17:0/1491583392 wait complete. 2024-03-19T06:07:58.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.056+0000 7efc70000640 1 Processor -- start 2024-03-19T06:07:58.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.056+0000 7efc70000640 1 -- start start 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc680cb8d0 0x7efc68149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc681541d0 0x7efc68149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6815ac50 con 0x7efc680cb8d0 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc68159da0 con 0x7efc680cb2d0 2024-03-19T06:07:58.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.058+0000 7efc70000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc680ca7e0 con 0x7efc681541d0 2024-03-19T06:07:58.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.060+0000 7efc6d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.060+0000 7efc6e000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc681541d0 0x7efc68149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.061+0000 7efc6d600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:35964/0 (socket says 172.21.15.17:35964) 2024-03-19T06:07:58.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.061+0000 7efc6d600640 1 -- 172.21.15.17:0/569669560 learned_addr learned my addr 172.21.15.17:0/569669560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.070+0000 7efc6d600640 1 -- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc681541d0 msgr2=0x7efc68149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.070+0000 7efc6d600640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc681541d0 0x7efc68149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.070+0000 7efc6d600640 1 -- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc680cb8d0 msgr2=0x7efc68149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.070+0000 7efc6d600640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc680cb8d0 0x7efc68149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.070+0000 7efc6d600640 1 -- 172.21.15.17:0/569669560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc68149230 con 0x7efc680cb2d0 2024-03-19T06:07:58.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.077+0000 7efc6d600640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009960 tx=0x7efc5c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.096+0000 7efc65600640 1 -- 172.21.15.17:0/569669560 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c048070 con 0x7efc680cb2d0 2024-03-19T06:07:58.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.097+0000 7efc65600640 1 -- 172.21.15.17:0/569669560 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c030660 con 0x7efc680cb2d0 2024-03-19T06:07:58.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.097+0000 7efc65600640 1 -- 172.21.15.17:0/569669560 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c034040 con 0x7efc680cb2d0 2024-03-19T06:07:58.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.097+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc68148d50 con 0x7efc680cb2d0 2024-03-19T06:07:58.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.097+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc68159270 con 0x7efc680cb2d0 2024-03-19T06:07:58.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.101+0000 7efc72dd1740 1 Processor -- start 2024-03-19T06:07:58.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.102+0000 7efc72dd1740 1 -- start start 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c42420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c40aa0 0x55dde3c818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3ba66f0 con 0x55dde3c8bec0 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3b4f9e0 con 0x55dde3c42040 2024-03-19T06:07:58.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dde3ba2790 con 0x55dde3c40aa0 2024-03-19T06:07:58.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.103+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.104+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57068/0 (socket says 172.21.15.17:57068) 2024-03-19T06:07:58.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.104+0000 7efc6d600640 1 -- 172.21.15.17:0/1507061216 learned_addr learned my addr 172.21.15.17:0/1507061216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.107+0000 7efc6d600640 1 -- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c40aa0 msgr2=0x55dde3c818a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.107+0000 7efc6d600640 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c40aa0 0x55dde3c818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.107+0000 7efc6d600640 1 -- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 msgr2=0x55dde3c42420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.107+0000 7efc6d600640 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c42420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.107+0000 7efc6d600640 1 -- 172.21.15.17:0/1507061216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dde3b43720 con 0x55dde3c8bec0 2024-03-19T06:07:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.109+0000 7efc6d600640 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02b9e0 tx=0x7efc5c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f77067900d3190 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.116+0000 7efc59c00640 1 -- 172.21.15.17:0/1507061216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c043610 con 0x55dde3c8bec0 2024-03-19T06:07:58.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.116+0000 7efc59c00640 1 -- 172.21.15.17:0/1507061216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c05c070 con 0x55dde3c8bec0 2024-03-19T06:07:58.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.116+0000 7efc59c00640 1 -- 172.21.15.17:0/1507061216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c043a30 con 0x55dde3c8bec0 2024-03-19T06:07:58.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.117+0000 7efc72dd1740 1 -- 172.21.15.17:0/1507061216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 msgr2=0x55dde3c42960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.117+0000 7efc72dd1740 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02b9e0 tx=0x7efc5c03d000 comp rx=0 tx=0).stop 2024-03-19T06:07:58.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 -- 172.21.15.17:0/1507061216 shutdown_connections 2024-03-19T06:07:58.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c40aa0 0x55dde3c818a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c42960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 --2- 172.21.15.17:0/1507061216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c42420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 -- 172.21.15.17:0/1507061216 >> 172.21.15.17:0/1507061216 conn(0x55dde3c3e7b0 msgr2=0x55dde3c410f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 -- 172.21.15.17:0/1507061216 shutdown_connections 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.118+0000 7efc72dd1740 1 -- 172.21.15.17:0/1507061216 wait complete. 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.119+0000 7efc72dd1740 1 -- start start 2024-03-19T06:07:58.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.119+0000 7efc72dd1740 1 Processor -- start 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.120+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c96510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.120+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.121+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c928c0 0x55dde3c81810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.121+0000 7efc72dd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3b4f9e0 con 0x55dde3c8bec0 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.121+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3b62e20 con 0x55dde3c42040 2024-03-19T06:07:58.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.121+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dde3ba66f0 con 0x55dde3c928c0 2024-03-19T06:07:58.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.121+0000 7efc72dd1740 10 client.0 _ll_register_callbacks cb 0x55dde3b9d8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:58.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.131+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.131+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57084/0 (socket says 172.21.15.17:57084) 2024-03-19T06:07:58.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.131+0000 7efc6d600640 1 -- 172.21.15.17:0/2372634548 learned_addr learned my addr 172.21.15.17:0/2372634548 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.135+0000 7efc6d600640 1 -- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c928c0 msgr2=0x55dde3c81810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.135+0000 7efc6d600640 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c928c0 0x55dde3c81810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.135+0000 7efc6d600640 1 -- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 msgr2=0x55dde3c96510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.135+0000 7efc6d600640 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c96510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.135+0000 7efc6d600640 1 -- 172.21.15.17:0/2372634548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dde38bb2d0 con 0x55dde3c8bec0 2024-03-19T06:07:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.138+0000 7efc6d600640 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55dde3c40830 tx=0x7efc5c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27a51c56f371bfa server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.138+0000 7efc4e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.143+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c065030 con 0x55dde3c8bec0 2024-03-19T06:07:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.143+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efc5c043e00 con 0x55dde3c8bec0 2024-03-19T06:07:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.143+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc5c05c070 con 0x55dde3c8bec0 2024-03-19T06:07:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.147+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc5c06a410 con 0x55dde3c8bec0 2024-03-19T06:07:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.147+0000 7efc72dd1740 10 client.4698 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.147+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55dde39856b0 con 0x55dde3c8bec0 2024-03-19T06:07:58.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c05c070 con 0x55dde3c8bec0 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7efc5c06a5b0 con 0x55dde3c8bec0 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 10 client.4698 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 10 client.4698 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 20 client.4698 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3c9f4e0 0x55dde3ca18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 4 client.4698 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:07:58.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.154+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 --> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dde3bb3c30 con 0x55dde3c9f4e0 2024-03-19T06:07:58.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.155+0000 7efc6e000640 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3c9f4e0 0x55dde3ca18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.222+0000 7efc6e000640 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3c9f4e0 0x55dde3ca18d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ac726ace65d7b31 server_cookie=85c12dc904476bd8 in_seq=0 out_seq=0 2024-03-19T06:07:58.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.222+0000 7efc4e000640 10 client.4698 ms_handle_connect on v2:172.21.15.17:6834/191121570 2024-03-19T06:07:58.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.258+0000 7efc65600640 1 -- 172.21.15.17:0/569669560 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efc5c068030 con 0x7efc680cb2d0 2024-03-19T06:07:58.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.260+0000 7efc65600640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 0x7efc4806e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.261+0000 7efc6cc00640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 0x7efc4806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.263+0000 7efc6cc00640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 0x7efc4806e080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55dde3c904f0 tx=0x7efc54006c40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.267+0000 7efc65600640 1 -- 172.21.15.17:0/569669560 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efc5c0086f0 con 0x7efc680cb2d0 2024-03-19T06:07:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.441+0000 7efc4e000640 1 -- 172.21.15.17:0/2372634548 <== mds.2 v2:172.21.15.17:6834/191121570 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dde3bb3c30 con 0x55dde3c9f4e0 2024-03-19T06:07:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.441+0000 7efc4e000640 10 client.4698 handle_command_reply: tid=0 2024-03-19T06:07:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.441+0000 7efc72dd1740 1 client.4698 shutdown 2024-03-19T06:07:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 msgr2=0x55dde3c60210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55dde3c40830 tx=0x7efc5c009240 comp rx=0 tx=0).stop 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 shutdown_connections 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3c9f4e0 0x55dde3ca18d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c928c0 0x55dde3c81810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3c60210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2372634548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42040 0x55dde3c96510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc4e000640 0 client.4698 ms_handle_reset on v2:172.21.15.17:6834/191121570 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.442+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 >> 172.21.15.17:0/2372634548 conn(0x55dde3c40aa0 msgr2=0x55dde3c42420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.443+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 shutdown_connections 2024-03-19T06:07:58.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.443+0000 7efc72dd1740 1 -- 172.21.15.17:0/2372634548 wait complete. 2024-03-19T06:07:58.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.443+0000 7efc72dd1740 20 client.4698 trim_cache size 0 max 16384 2024-03-19T06:07:58.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.473+0000 7efc72dd1740 1 Processor -- start 2024-03-19T06:07:58.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.473+0000 7efc72dd1740 1 -- start start 2024-03-19T06:07:58.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.474+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.474+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c8bec0 0x55dde3c3b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.474+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c42420 0x55dde3c428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.475+0000 7efc72dd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc681fbe60 con 0x55dde3c42040 2024-03-19T06:07:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.475+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3b62e20 con 0x55dde3c8bec0 2024-03-19T06:07:58.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.475+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dde3b4f9e0 con 0x55dde3c42420 2024-03-19T06:07:58.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.475+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.476+0000 7efc6d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57088/0 (socket says 172.21.15.17:57088) 2024-03-19T06:07:58.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.476+0000 7efc6d600640 1 -- 172.21.15.17:0/427259997 learned_addr learned my addr 172.21.15.17:0/427259997 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.477+0000 7efc6cc00640 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c8bec0 0x55dde3c3b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.477+0000 7efc6e000640 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c42420 0x55dde3c428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.479+0000 7efc6d600640 1 -- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c42420 msgr2=0x55dde3c428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.479+0000 7efc6d600640 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c42420 0x55dde3c428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.479+0000 7efc6d600640 1 -- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c8bec0 msgr2=0x55dde3c3b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.479+0000 7efc6d600640 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c8bec0 0x55dde3c3b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.479+0000 7efc6d600640 1 -- 172.21.15.17:0/427259997 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dde3c7e140 con 0x55dde3c42040 2024-03-19T06:07:58.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.481+0000 7efc6d600640 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02b9e0 tx=0x7efc5c0693c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624493a17f5ffe3a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.486+0000 7efc59200640 1 -- 172.21.15.17:0/427259997 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c065070 con 0x55dde3c42040 2024-03-19T06:07:58.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.486+0000 7efc59200640 1 -- 172.21.15.17:0/427259997 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c001d20 con 0x55dde3c42040 2024-03-19T06:07:58.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.486+0000 7efc59200640 1 -- 172.21.15.17:0/427259997 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c000ed0 con 0x55dde3c42040 2024-03-19T06:07:58.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 -- 172.21.15.17:0/427259997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 msgr2=0x55dde3c3b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc5c02b9e0 tx=0x7efc5c0693c0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 -- 172.21.15.17:0/427259997 shutdown_connections 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c42420 0x55dde3c428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c8bec0 0x55dde3c3b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 --2- 172.21.15.17:0/427259997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c42040 0x55dde3c3b3b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 -- 172.21.15.17:0/427259997 >> 172.21.15.17:0/427259997 conn(0x55dde3c40aa0 msgr2=0x55dde3c8b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 -- 172.21.15.17:0/427259997 shutdown_connections 2024-03-19T06:07:58.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.487+0000 7efc72dd1740 1 -- 172.21.15.17:0/427259997 wait complete. 2024-03-19T06:07:58.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.488+0000 7efc72dd1740 1 -- start start 2024-03-19T06:07:58.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.488+0000 7efc72dd1740 1 Processor -- start 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42420 0x55dde3c3b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c5b040 0x55dde3cf0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3c800b0 con 0x55dde3c8bec0 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dde3c96c60 con 0x55dde3c42420 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dde3c7d4d0 con 0x55dde3c5b040 2024-03-19T06:07:58.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.489+0000 7efc72dd1740 10 client.0 _ll_register_callbacks cb 0x7efc5c046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:58.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.490+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.491+0000 7efc6cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57102/0 (socket says 172.21.15.17:57102) 2024-03-19T06:07:58.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.491+0000 7efc6cc00640 1 -- 172.21.15.17:0/2861409482 learned_addr learned my addr 172.21.15.17:0/2861409482 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.491+0000 7efc6e000640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c5b040 0x55dde3cf0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6cc00640 1 -- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c5b040 msgr2=0x55dde3cf0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6d600640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42420 0x55dde3c3b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6cc00640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c5b040 0x55dde3cf0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6cc00640 1 -- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42420 msgr2=0x55dde3c3b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6cc00640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42420 0x55dde3c3b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.495+0000 7efc6cc00640 1 -- 172.21.15.17:0/2861409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dde3c7f590 con 0x55dde3c8bec0 2024-03-19T06:07:58.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.499+0000 7efc6cc00640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efc6815b0e0 tx=0x7efc54004810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2359d67cb0ba5d0c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.499+0000 7efc4e000640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:58.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.506+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5401f5f0 con 0x55dde3c8bec0 2024-03-19T06:07:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.506+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efc5401f790 con 0x55dde3c8bec0 2024-03-19T06:07:58.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.506+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dde3badf80 con 0x55dde3c8bec0 2024-03-19T06:07:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.509+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc5401f990 con 0x55dde3c8bec0 2024-03-19T06:07:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.509+0000 7efc72dd1740 10 client.4704 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:58.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.509+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55dde3c963b0 con 0x55dde3c8bec0 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dde3badf80 con 0x55dde3c8bec0 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7efc54012070 con 0x55dde3c8bec0 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 10 client.4704 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 10 client.4704 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 20 client.4704 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3d00f70 0x55dde3d03360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 4 client.4704 mds_command: new command op to 4242 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:07:58.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.515+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 --> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dde3b2c860 con 0x55dde3d00f70 2024-03-19T06:07:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.517+0000 7efc6d600640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3d00f70 0x55dde3d03360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.525+0000 7efc6d600640 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3d00f70 0x55dde3d03360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33cfc77bcd24d64a server_cookie=7dc5897cf0767e63 in_seq=0 out_seq=0 2024-03-19T06:07:58.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.525+0000 7efc4e000640 10 client.4704 ms_handle_connect on v2:172.21.15.17:6834/191121570 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.551+0000 7efc4e000640 1 -- 172.21.15.17:0/2861409482 <== mds.2 v2:172.21.15.17:6834/191121570 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55dde3b2c860 con 0x55dde3d00f70 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc4e000640 10 client.4704 handle_command_reply: tid=0 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 client.4704 shutdown 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 msgr2=0x55dde3ca6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efc6815b0e0 tx=0x7efc54004810 comp rx=0 tx=0).stop 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 shutdown_connections 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:6834/191121570,v1:172.21.15.17:6835/191121570] conn(0x55dde3d00f70 0x55dde3d03360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55dde3c5b040 0x55dde3cf0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55dde3c8bec0 0x55dde3ca6190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 --2- 172.21.15.17:0/2861409482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dde3c42420 0x55dde3c3b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 >> 172.21.15.17:0/2861409482 conn(0x55dde3c40aa0 msgr2=0x55dde3c42800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.552+0000 7efc4e000640 0 client.4704 ms_handle_reset on v2:172.21.15.17:6834/191121570 2024-03-19T06:07:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.553+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 shutdown_connections 2024-03-19T06:07:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.553+0000 7efc72dd1740 1 -- 172.21.15.17:0/2861409482 wait complete. 2024-03-19T06:07:58.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.553+0000 7efc72dd1740 20 client.4704 trim_cache size 0 max 16384 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 2, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4242, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 28.114331352000001, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 20, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2024-03-19T06:07:58.545 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 97.064808986000003 2024-03-19T06:07:58.546 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:07:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 msgr2=0x7efc4806e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 0x7efc4806e080 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55dde3c904f0 tx=0x7efc54006c40 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 msgr2=0x7efc680ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009960 tx=0x7efc5c004730 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 shutdown_connections 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc681541d0 0x7efc68149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc680cb8d0 0x7efc68149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc4806bbc0 0x7efc4806e080 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 --2- 172.21.15.17:0/569669560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc680cb2d0 0x7efc680ce770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 >> 172.21.15.17:0/569669560 conn(0x7efc6806baf0 msgr2=0x7efc680c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.554+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 shutdown_connections 2024-03-19T06:07:58.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.555+0000 7efc70000640 1 -- 172.21.15.17:0/569669560 wait complete. 2024-03-19T06:07:58.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-19T06:07:58.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.803+0000 7fc5ae200640 1 Processor -- start 2024-03-19T06:07:58.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.804+0000 7fc5ae200640 1 -- start start 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5a81586a0 0x7fc5a815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5a80c7570 0x7fc5a8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a806e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a8073170 con 0x7fc5a80c7570 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80c6b70 con 0x7fc5a81586a0 2024-03-19T06:07:58.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.805+0000 7fc5ae200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8162660 con 0x7fc5a8071170 2024-03-19T06:07:58.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.807+0000 7fc5a7400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5a81586a0 0x7fc5a815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.807+0000 7fc5a7e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.807+0000 7fc59ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5a80c7570 0x7fc5a8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.808+0000 7fc59ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc5a80c7570 0x7fc5a8070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57110/0 (socket says 172.21.15.17:57110) 2024-03-19T06:07:58.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.808+0000 7fc59ea00640 1 -- 172.21.15.17:0/752940678 learned_addr learned my addr 172.21.15.17:0/752940678 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.811+0000 7fc59ea00640 1 -- 172.21.15.17:0/752940678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 msgr2=0x7fc5a806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.811+0000 7fc59ea00640 1 --2- 172.21.15.17:0/752940678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a806e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.811+0000 7fc59ea00640 1 -- 172.21.15.17:0/752940678 >> v2:172.21.15.153:3300/0 conn(0x7fc5a81586a0 msgr2=0x7fc5a815ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.811+0000 7fc59ea00640 1 --2- 172.21.15.17:0/752940678 >> v2:172.21.15.153:3300/0 conn(0x7fc5a81586a0 0x7fc5a815ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.811+0000 7fc59ea00640 1 -- 172.21.15.17:0/752940678 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80c6890 con 0x7fc5a80c7570 2024-03-19T06:07:58.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.814+0000 7fc59ea00640 1 --2- 172.21.15.17:0/752940678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a80c7570 0x7fc5a8070c30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc5a806f540 tx=0x7fc59002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2308d5f32609d87a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.821+0000 7fc5a6a00640 1 -- 172.21.15.17:0/752940678 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590034070 con 0x7fc5a80c7570 2024-03-19T06:07:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.821+0000 7fc5a6a00640 1 -- 172.21.15.17:0/752940678 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590030840 con 0x7fc5a80c7570 2024-03-19T06:07:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.821+0000 7fc5a6a00640 1 -- 172.21.15.17:0/752940678 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590030c10 con 0x7fc5a80c7570 2024-03-19T06:07:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.822+0000 7fc5ae200640 1 -- 172.21.15.17:0/752940678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a80c7570 msgr2=0x7fc5a8070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.822+0000 7fc5ae200640 1 --2- 172.21.15.17:0/752940678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a80c7570 0x7fc5a8070c30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc5a806f540 tx=0x7fc59002b980 comp rx=0 tx=0).stop 2024-03-19T06:07:58.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 -- 172.21.15.17:0/752940678 shutdown_connections 2024-03-19T06:07:58.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 --2- 172.21.15.17:0/752940678 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a806e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 --2- 172.21.15.17:0/752940678 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a80c7570 0x7fc5a8070c30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 --2- 172.21.15.17:0/752940678 >> v2:172.21.15.153:3300/0 conn(0x7fc5a81586a0 0x7fc5a815ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 -- 172.21.15.17:0/752940678 >> 172.21.15.17:0/752940678 conn(0x7fc5a80c8910 msgr2=0x7fc5a80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 -- 172.21.15.17:0/752940678 shutdown_connections 2024-03-19T06:07:58.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.823+0000 7fc5ae200640 1 -- 172.21.15.17:0/752940678 wait complete. 2024-03-19T06:07:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.825+0000 7fc5ae200640 1 Processor -- start 2024-03-19T06:07:58.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.825+0000 7fc5ae200640 1 -- start start 2024-03-19T06:07:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a81f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a80c7570 0x7fc5a8151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8161e60 con 0x7fc5a81586a0 2024-03-19T06:07:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8161b80 con 0x7fc5a80c7570 2024-03-19T06:07:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.826+0000 7fc5ae200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8162140 con 0x7fc5a8071170 2024-03-19T06:07:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.827+0000 7fc5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.827+0000 7fc5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57122/0 (socket says 172.21.15.17:57122) 2024-03-19T06:07:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.827+0000 7fc5a7e00640 1 -- 172.21.15.17:0/3947786729 learned_addr learned my addr 172.21.15.17:0/3947786729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.828+0000 7fc5a7400640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a81f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.831+0000 7fc5a7e00640 1 -- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 msgr2=0x7fc5a81f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.831+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a81f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.831+0000 7fc5a7e00640 1 -- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a80c7570 msgr2=0x7fc5a8151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.831+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a80c7570 0x7fc5a8151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.831+0000 7fc5a7e00640 1 -- 172.21.15.17:0/3947786729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8151540 con 0x7fc5a81586a0 2024-03-19T06:07:58.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.834+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000e820 tx=0x7fc5a000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.838+0000 7fc59fe00640 1 -- 172.21.15.17:0/3947786729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0017070 con 0x7fc5a81586a0 2024-03-19T06:07:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.838+0000 7fc59fe00640 1 -- 172.21.15.17:0/3947786729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a000c730 con 0x7fc5a81586a0 2024-03-19T06:07:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.838+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a814f540 con 0x7fc5a81586a0 2024-03-19T06:07:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.838+0000 7fc59fe00640 1 -- 172.21.15.17:0/3947786729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a000cb20 con 0x7fc5a81586a0 2024-03-19T06:07:58.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.839+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a814fb00 con 0x7fc5a81586a0 2024-03-19T06:07:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.842+0000 7fc5b0fc1740 1 Processor -- start 2024-03-19T06:07:58.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 -- start start 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce6562aec0 0x55ce655e1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655dfaa0 0x55ce656208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce655456f0 con 0x55ce655dfaa0 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce654ee9e0 con 0x55ce6562aec0 2024-03-19T06:07:58.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.843+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce65541790 con 0x55ce655e1040 2024-03-19T06:07:58.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.849+0000 7fc59ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.850+0000 7fc59ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:56064/0 (socket says 172.21.15.17:56064) 2024-03-19T06:07:58.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.850+0000 7fc59ea00640 1 -- 172.21.15.17:0/1473600640 learned_addr learned my addr 172.21.15.17:0/1473600640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.856+0000 7fc59ea00640 1 -- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce6562aec0 msgr2=0x55ce655e1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.856+0000 7fc59ea00640 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce6562aec0 0x55ce655e1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.856+0000 7fc59ea00640 1 -- 172.21.15.17:0/1473600640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655dfaa0 msgr2=0x55ce656208a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.856+0000 7fc59ea00640 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655dfaa0 0x55ce656208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.856+0000 7fc59ea00640 1 -- 172.21.15.17:0/1473600640 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce654e2720 con 0x55ce655e1040 2024-03-19T06:07:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.862+0000 7fc59fe00640 1 -- 172.21.15.17:0/3947786729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc5a001a070 con 0x7fc5a81586a0 2024-03-19T06:07:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.862+0000 7fc59ea00640 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07cbdb23924a3db server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.863+0000 7fc59fe00640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 0x7fc58406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.864+0000 7fc5a7400640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 0x7fc58406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.864+0000 7fc5a7400640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 0x7fc58406e0e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55ce6562b2c0 tx=0x7fc598009750 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.865+0000 7fc59fe00640 1 -- 172.21.15.17:0/3947786729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc5a00570c0 con 0x7fc5a81586a0 2024-03-19T06:07:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.874+0000 7fc597400640 1 -- 172.21.15.17:0/1473600640 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590047070 con 0x55ce655e1040 2024-03-19T06:07:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.874+0000 7fc597400640 1 -- 172.21.15.17:0/1473600640 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590030640 con 0x55ce655e1040 2024-03-19T06:07:58.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.874+0000 7fc597400640 1 -- 172.21.15.17:0/1473600640 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590034040 con 0x55ce655e1040 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 msgr2=0x55ce655e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc590000c00 tx=0x7fc590004730 comp rx=0 tx=0).stop 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1473600640 shutdown_connections 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655dfaa0 0x55ce656208a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce6562aec0 0x55ce655e1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1473600640 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce655e1420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1473600640 >> 172.21.15.17:0/1473600640 conn(0x55ce655dd7b0 msgr2=0x55ce655e00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1473600640 shutdown_connections 2024-03-19T06:07:58.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.875+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1473600640 wait complete. 2024-03-19T06:07:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.876+0000 7fc5b0fc1740 1 -- start start 2024-03-19T06:07:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.877+0000 7fc5b0fc1740 1 Processor -- start 2024-03-19T06:07:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce656267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65635720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce656065a0 con 0x55ce655e1040 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce65501e20 con 0x55ce65626ce0 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce655de960 con 0x55ce6562aec0 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5b0fc1740 10 client.0 _ll_register_callbacks cb 0x55ce6553c8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.879+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.880+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57132/0 (socket says 172.21.15.17:57132) 2024-03-19T06:07:58.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.880+0000 7fc5a7400640 1 -- 172.21.15.17:0/4000325084 learned_addr learned my addr 172.21.15.17:0/4000325084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:58.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.882+0000 7fc59ea00640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce656267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.883+0000 7fc5a7400640 1 -- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 msgr2=0x55ce656267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.883+0000 7fc5a7400640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce656267a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.883+0000 7fc5a7400640 1 -- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 msgr2=0x55ce65635720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.883+0000 7fc5a7400640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65635720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:58.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.883+0000 7fc5a7400640 1 -- 172.21.15.17:0/4000325084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce6525a2d0 con 0x55ce655e1040 2024-03-19T06:07:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.886+0000 7fc5a7400640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc598015e40 tx=0x7fc598004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b6508351e95818 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:58.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.886+0000 7fc58be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.890+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59801d050 con 0x55ce655e1040 2024-03-19T06:07:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.890+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc598022640 con 0x55ce655e1040 2024-03-19T06:07:58.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.890+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc590030640 con 0x55ce655e1040 2024-03-19T06:07:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.893+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc598022840 con 0x55ce655e1040 2024-03-19T06:07:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.893+0000 7fc5b0fc1740 10 client.4713 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:58.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.893+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55ce653246b0 con 0x55ce655e1040 2024-03-19T06:07:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc590030640 con 0x55ce655e1040 2024-03-19T06:07:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fc598032020 con 0x55ce655e1040 2024-03-19T06:07:58.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 10 client.4713 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 10 client.4713 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-19T06:07:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 20 client.4713 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce6563ef60 0x55ce65641350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 4 client.4713 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:07:58.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.899+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 --> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce65552c30 con 0x55ce6563ef60 2024-03-19T06:07:58.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.902+0000 7fc59ea00640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce6563ef60 0x55ce65641350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:58.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.999+0000 7fc59ea00640 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce6563ef60 0x55ce65641350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31004a50501d6255 server_cookie=77e525daea9dc588 in_seq=0 out_seq=0 2024-03-19T06:07:58.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:58.999+0000 7fc58be00640 10 client.4713 ms_handle_connect on v2:172.21.15.153:6832/578472937 2024-03-19T06:07:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.163+0000 7fc58be00640 1 -- 172.21.15.17:0/4000325084 <== mds.1 v2:172.21.15.153:6832/578472937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ce65552c30 con 0x55ce6563ef60 2024-03-19T06:07:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.163+0000 7fc58be00640 10 client.4713 handle_command_reply: tid=0 2024-03-19T06:07:59.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.163+0000 7fc5b0fc1740 1 client.4713 shutdown 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 msgr2=0x55ce6561e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc598015e40 tx=0x7fc598004ab0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 shutdown_connections 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce6563ef60 0x55ce65641350 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65635720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce656267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/4000325084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce6561e0a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 >> 172.21.15.17:0/4000325084 conn(0x55ce655dfaa0 msgr2=0x55ce65620c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.164+0000 7fc58be00640 0 client.4713 ms_handle_reset on v2:172.21.15.153:6832/578472937 2024-03-19T06:07:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.165+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 shutdown_connections 2024-03-19T06:07:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.165+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/4000325084 wait complete. 2024-03-19T06:07:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.165+0000 7fc5b0fc1740 20 client.4713 trim_cache size 0 max 16384 2024-03-19T06:07:59.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.208+0000 7fc5b0fc1740 1 Processor -- start 2024-03-19T06:07:59.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.208+0000 7fc5b0fc1740 1 -- start start 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce656058f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65605e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a82002d0 con 0x55ce6562aec0 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce65604860 con 0x55ce65626ce0 2024-03-19T06:07:59.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.210+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce6561d8a0 con 0x55ce655e1040 2024-03-19T06:07:59.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.212+0000 7fc5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.212+0000 7fc59ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65605e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.213+0000 7fc5a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57142/0 (socket says 172.21.15.17:57142) 2024-03-19T06:07:59.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.213+0000 7fc5a7e00640 1 -- 172.21.15.17:0/1436741338 learned_addr learned my addr 172.21.15.17:0/1436741338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.213+0000 7fc5a7400640 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce656058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.216+0000 7fc5a7e00640 1 -- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 msgr2=0x55ce656058f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.216+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce656058f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.216+0000 7fc5a7e00640 1 -- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 msgr2=0x55ce65605e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.216+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65605e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.216+0000 7fc5a7e00640 1 -- 172.21.15.17:0/1436741338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce6561f5d0 con 0x55ce6562aec0 2024-03-19T06:07:59.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.219+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0089080 tx=0x7fc5a0061710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f14a9b44ee3232 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.224+0000 7fc596a00640 1 -- 172.21.15.17:0/1436741338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0021030 con 0x55ce6562aec0 2024-03-19T06:07:59.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.224+0000 7fc596a00640 1 -- 172.21.15.17:0/1436741338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0087070 con 0x55ce6562aec0 2024-03-19T06:07:59.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.224+0000 7fc596a00640 1 -- 172.21.15.17:0/1436741338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a00586b0 con 0x55ce6562aec0 2024-03-19T06:07:59.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.225+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1436741338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 msgr2=0x55ce655e1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.225+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0089080 tx=0x7fc5a0061710 comp rx=0 tx=0).stop 2024-03-19T06:07:59.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1436741338 shutdown_connections 2024-03-19T06:07:59.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce6562aec0 0x55ce655e1420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65605e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/1436741338 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce655e1040 0x55ce656058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1436741338 >> 172.21.15.17:0/1436741338 conn(0x55ce655dfaa0 msgr2=0x55ce655dffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1436741338 shutdown_connections 2024-03-19T06:07:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.226+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/1436741338 wait complete. 2024-03-19T06:07:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.228+0000 7fc5b0fc1740 1 -- start start 2024-03-19T06:07:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.228+0000 7fc5b0fc1740 1 Processor -- start 2024-03-19T06:07:59.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65687770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce655de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce65629da0 con 0x55ce655e1040 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce6561e8c0 con 0x55ce65626ce0 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce65607460 con 0x55ce6562aec0 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.231+0000 7fc5b0fc1740 10 client.0 _ll_register_callbacks cb 0x7fc5980095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.232+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.232+0000 7fc59ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65687770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.232+0000 7fc5a7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57148/0 (socket says 172.21.15.17:57148) 2024-03-19T06:07:59.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.232+0000 7fc5a7400640 1 -- 172.21.15.17:0/2216071328 learned_addr learned my addr 172.21.15.17:0/2216071328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.233+0000 7fc5a7e00640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce655de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.236+0000 7fc5a7400640 1 -- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 msgr2=0x55ce655de8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.236+0000 7fc5a7400640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce655de8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.236+0000 7fc5a7400640 1 -- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 msgr2=0x55ce65687770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.236+0000 7fc5a7400640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65687770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.236+0000 7fc5a7400640 1 -- 172.21.15.17:0/2216071328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce656040f0 con 0x55ce655e1040 2024-03-19T06:07:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.240+0000 7fc5a7400640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc598009fd0 tx=0x7fc598020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4962c916c39caed server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.240+0000 7fc58be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:59.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.245+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc598040060 con 0x55ce655e1040 2024-03-19T06:07:59.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.245+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc598003da0 con 0x55ce655e1040 2024-03-19T06:07:59.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.245+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5a0087070 con 0x55ce655e1040 2024-03-19T06:07:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.248+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc59801d040 con 0x55ce655e1040 2024-03-19T06:07:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.248+0000 7fc5b0fc1740 10 client.4719 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:59.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.248+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55ce655e1c40 con 0x55ce655e1040 2024-03-19T06:07:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0087070 con 0x55ce655e1040 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fc598046620 con 0x55ce655e1040 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 10 client.4719 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 10 client.4719 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 20 client.4719 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce655dab60 0x55ce65699d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 4 client.4719 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:07:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.254+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 --> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce6554cf80 con 0x55ce655dab60 2024-03-19T06:07:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.256+0000 7fc59ea00640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce655dab60 0x55ce65699d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.267+0000 7fc59ea00640 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce655dab60 0x55ce65699d70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae5e34631c0c8daa server_cookie=529c52a8df7dbb30 in_seq=0 out_seq=0 2024-03-19T06:07:59.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.267+0000 7fc58be00640 10 client.4719 ms_handle_connect on v2:172.21.15.153:6832/578472937 2024-03-19T06:07:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.298+0000 7fc58be00640 1 -- 172.21.15.17:0/2216071328 <== mds.1 v2:172.21.15.153:6832/578472937 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ce6554cf80 con 0x55ce655dab60 2024-03-19T06:07:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.298+0000 7fc58be00640 10 client.4719 handle_command_reply: tid=0 2024-03-19T06:07:59.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.298+0000 7fc5b0fc1740 1 client.4719 shutdown 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 msgr2=0x55ce656385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc598009fd0 tx=0x7fc598020000 comp rx=0 tx=0).stop 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 shutdown_connections 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:6832/578472937,v1:172.21.15.153:6833/578472937] conn(0x55ce655dab60 0x55ce65699d70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x55ce6562aec0 0x55ce655de8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ce65626ce0 0x55ce65687770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 --2- 172.21.15.17:0/2216071328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55ce655e1040 0x55ce656385c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc58be00640 0 client.4719 ms_handle_reset on v2:172.21.15.153:6832/578472937 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 >> 172.21.15.17:0/2216071328 conn(0x55ce655dfaa0 msgr2=0x55ce65629690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.299+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 shutdown_connections 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.300+0000 7fc5b0fc1740 1 -- 172.21.15.17:0/2216071328 wait complete. 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.300+0000 7fc5b0fc1740 20 client.4719 trim_cache size 0 max 16384 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:07:59.291 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 1, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4264, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 36.013059501999997, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 20, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 98.014843648999999 2024-03-19T06:07:59.292 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 msgr2=0x7fc58406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 0x7fc58406e0e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55ce6562b2c0 tx=0x7fc598009750 comp rx=0 tx=0).stop 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 msgr2=0x7fc5a80ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000e820 tx=0x7fc5a000ece0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 shutdown_connections 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5a81586a0 0x7fc5a80ca480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc58406bc20 0x7fc58406e0e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5a80c7570 0x7fc5a8151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 --2- 172.21.15.17:0/3947786729 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc5a8071170 0x7fc5a81f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 >> 172.21.15.17:0/3947786729 conn(0x7fc5a80c8910 msgr2=0x7fc5a8160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 shutdown_connections 2024-03-19T06:07:59.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.302+0000 7fc5ae200640 1 -- 172.21.15.17:0/3947786729 wait complete. 2024-03-19T06:07:59.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-19T06:07:59.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.568+0000 7fd52da00640 1 Processor -- start 2024-03-19T06:07:59.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.568+0000 7fd52da00640 1 -- start start 2024-03-19T06:07:59.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd5280ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5280cb8d0 0x7fd5280cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 0x7fd52815d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52815d3b0 con 0x7fd5280cb8d0 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52815a0d0 con 0x7fd5280cb2d0 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.570+0000 7fd52da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52815a3b0 con 0x7fd5281541d0 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.571+0000 7fd526000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5280cb8d0 0x7fd5280cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.571+0000 7fd526000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5280cb8d0 0x7fd5280cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57154/0 (socket says 172.21.15.17:57154) 2024-03-19T06:07:59.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.571+0000 7fd526000640 1 -- 172.21.15.17:0/1246445329 learned_addr learned my addr 172.21.15.17:0/1246445329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.572+0000 7fd527400640 1 --2- 172.21.15.17:0/1246445329 >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 0x7fd52815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.572+0000 7fd526a00640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd5280ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd526000640 1 -- 172.21.15.17:0/1246445329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 msgr2=0x7fd5280ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd526000640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd5280ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd526000640 1 -- 172.21.15.17:0/1246445329 >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 msgr2=0x7fd52815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd526000640 1 --2- 172.21.15.17:0/1246445329 >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 0x7fd52815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd526000640 1 -- 172.21.15.17:0/1246445329 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52815a690 con 0x7fd5280cb8d0 2024-03-19T06:07:59.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.575+0000 7fd527400640 1 --2- 172.21.15.17:0/1246445329 >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 0x7fd52815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:07:59.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.578+0000 7fd526000640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb8d0 0x7fd5280cad90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c6930 tx=0x7fd51002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab24573d1158e4a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.582+0000 7fd525600640 1 -- 172.21.15.17:0/1246445329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510034070 con 0x7fd5280cb8d0 2024-03-19T06:07:59.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.583+0000 7fd525600640 1 -- 172.21.15.17:0/1246445329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510030850 con 0x7fd5280cb8d0 2024-03-19T06:07:59.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.583+0000 7fd525600640 1 -- 172.21.15.17:0/1246445329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510030c20 con 0x7fd5280cb8d0 2024-03-19T06:07:59.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.583+0000 7fd52da00640 1 -- 172.21.15.17:0/1246445329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb8d0 msgr2=0x7fd5280cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.583+0000 7fd52da00640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb8d0 0x7fd5280cad90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5280c6930 tx=0x7fd51002b990 comp rx=0 tx=0).stop 2024-03-19T06:07:59.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 -- 172.21.15.17:0/1246445329 shutdown_connections 2024-03-19T06:07:59.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 --2- 172.21.15.17:0/1246445329 >> v2:172.21.15.153:3300/0 conn(0x7fd5280cb2d0 0x7fd52815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb8d0 0x7fd5280cad90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 --2- 172.21.15.17:0/1246445329 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd5280ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 -- 172.21.15.17:0/1246445329 >> 172.21.15.17:0/1246445329 conn(0x7fd52806baf0 msgr2=0x7fd52806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 -- 172.21.15.17:0/1246445329 shutdown_connections 2024-03-19T06:07:59.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.584+0000 7fd52da00640 1 -- 172.21.15.17:0/1246445329 wait complete. 2024-03-19T06:07:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.586+0000 7fd52da00640 1 Processor -- start 2024-03-19T06:07:59.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.587+0000 7fd52da00640 1 -- start start 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5280cb8d0 0x7fd52815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd52814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52815ac50 con 0x7fd5280cb2d0 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528159da0 con 0x7fd5280cb8d0 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.588+0000 7fd52da00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280ca7e0 con 0x7fd5281541d0 2024-03-19T06:07:59.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.589+0000 7fd526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.589+0000 7fd526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57158/0 (socket says 172.21.15.17:57158) 2024-03-19T06:07:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.589+0000 7fd526a00640 1 -- 172.21.15.17:0/3997510685 learned_addr learned my addr 172.21.15.17:0/3997510685 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.590+0000 7fd526000640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5280cb8d0 0x7fd52815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.591+0000 7fd527400640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd52814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.594+0000 7fd526a00640 1 -- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 msgr2=0x7fd52814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.594+0000 7fd526a00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd52814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.594+0000 7fd526a00640 1 -- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5280cb8d0 msgr2=0x7fd52815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.594+0000 7fd526a00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5280cb8d0 0x7fd52815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.594+0000 7fd526a00640 1 -- 172.21.15.17:0/3997510685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5281e3200 con 0x7fd5280cb2d0 2024-03-19T06:07:59.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.597+0000 7fd526a00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd518007f20 tx=0x7fd51800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.602+0000 7fd51ea00640 1 -- 172.21.15.17:0/3997510685 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518014620 con 0x7fd5280cb2d0 2024-03-19T06:07:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.602+0000 7fd51ea00640 1 -- 172.21.15.17:0/3997510685 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518019070 con 0x7fd5280cb2d0 2024-03-19T06:07:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.602+0000 7fd51ea00640 1 -- 172.21.15.17:0/3997510685 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518014a00 con 0x7fd5280cb2d0 2024-03-19T06:07:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.602+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5281e34a0 con 0x7fd5280cb2d0 2024-03-19T06:07:59.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.603+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5281f3480 con 0x7fd5280cb2d0 2024-03-19T06:07:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.606+0000 7fd5307ce740 1 Processor -- start 2024-03-19T06:07:59.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.607+0000 7fd5307ce740 1 -- start start 2024-03-19T06:07:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007e94420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007e92aa0 0x563007ed38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007df86f0 con 0x563007e94040 2024-03-19T06:07:59.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007da19e0 con 0x563007eddec0 2024-03-19T06:07:59.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.608+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x563007df4790 con 0x563007e92aa0 2024-03-19T06:07:59.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.614+0000 7fd526000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007e92aa0 0x563007ed38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.614+0000 7fd526a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.615+0000 7fd526a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:36102/0 (socket says 172.21.15.17:36102) 2024-03-19T06:07:59.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.615+0000 7fd526a00640 1 -- 172.21.15.17:0/2514996850 learned_addr learned my addr 172.21.15.17:0/2514996850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.621+0000 7fd526a00640 1 -- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007e92aa0 msgr2=0x563007ed38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.621+0000 7fd526a00640 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007e92aa0 0x563007ed38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.621+0000 7fd526a00640 1 -- 172.21.15.17:0/2514996850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 msgr2=0x563007e94420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.621+0000 7fd526a00640 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007e94420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.621+0000 7fd526a00640 1 -- 172.21.15.17:0/2514996850 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007d95720 con 0x563007eddec0 2024-03-19T06:07:59.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.627+0000 7fd526a00640 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd518000f80 tx=0x7fd518013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f22b3e4221703ad server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.633+0000 7fd51ea00640 1 -- 172.21.15.17:0/3997510685 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd51801e9b0 con 0x7fd5280cb2d0 2024-03-19T06:07:59.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.634+0000 7fd51ea00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 0x7fd50406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.634+0000 7fd527400640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 0x7fd50406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.636+0000 7fd527400640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 0x7fd50406e110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b400 tx=0x7fd52000b390 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.638+0000 7fd51ea00640 1 -- 172.21.15.17:0/3997510685 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd51805a9a0 con 0x7fd5280cb2d0 2024-03-19T06:07:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.638+0000 7fd517400640 1 -- 172.21.15.17:0/2514996850 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518058ba0 con 0x563007eddec0 2024-03-19T06:07:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.638+0000 7fd517400640 1 -- 172.21.15.17:0/2514996850 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51805c900 con 0x563007eddec0 2024-03-19T06:07:59.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.638+0000 7fd517400640 1 -- 172.21.15.17:0/2514996850 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51805c260 con 0x563007eddec0 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 -- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 msgr2=0x563007e94960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd518000f80 tx=0x7fd518013000 comp rx=0 tx=0).stop 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 -- 172.21.15.17:0/2514996850 shutdown_connections 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007e92aa0 0x563007ed38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007e94960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 --2- 172.21.15.17:0/2514996850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007e94420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 -- 172.21.15.17:0/2514996850 >> 172.21.15.17:0/2514996850 conn(0x563007e907b0 msgr2=0x563007e930f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 -- 172.21.15.17:0/2514996850 shutdown_connections 2024-03-19T06:07:59.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.639+0000 7fd5307ce740 1 -- 172.21.15.17:0/2514996850 wait complete. 2024-03-19T06:07:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.640+0000 7fd5307ce740 1 -- start start 2024-03-19T06:07:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.640+0000 7fd5307ce740 1 Processor -- start 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.641+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 0x563007eadf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.641+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007eafd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd5307ce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007eb95a0 con 0x563007ed86e0 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007db4e20 con 0x563007e94040 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x563007e91960 con 0x563007eddec0 2024-03-19T06:07:59.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd5307ce740 10 client.0 _ll_register_callbacks cb 0x563007def8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.642+0000 7fd527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.643+0000 7fd527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57174/0 (socket says 172.21.15.17:57174) 2024-03-19T06:07:59.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.643+0000 7fd527400640 1 -- 172.21.15.17:0/3056171543 learned_addr learned my addr 172.21.15.17:0/3056171543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.644+0000 7fd526000640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007eafd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.645+0000 7fd526a00640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 0x563007eadf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.646+0000 7fd527400640 1 -- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 msgr2=0x563007eafd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.646+0000 7fd527400640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007eafd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.647+0000 7fd527400640 1 -- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 msgr2=0x563007eadf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.647+0000 7fd527400640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 0x563007eadf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.647+0000 7fd527400640 1 -- 172.21.15.17:0/3056171543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563007b0d2d0 con 0x563007ed86e0 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.647+0000 7fd526000640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007eafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:07:59.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.647+0000 7fd526a00640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 0x563007eadf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-19T06:07:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.649+0000 7fd527400640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd520004700 tx=0x7fd520004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c64535beba9818d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.649+0000 7fd50be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.653+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52001c050 con 0x563007ed86e0 2024-03-19T06:07:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.653+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd520014800 con 0x563007ed86e0 2024-03-19T06:07:59.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.653+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd51805c900 con 0x563007ed86e0 2024-03-19T06:07:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.656+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd52002e050 con 0x563007ed86e0 2024-03-19T06:07:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.656+0000 7fd5307ce740 10 client.4728 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:59.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.656+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x563007bd76b0 con 0x563007ed86e0 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51805c900 con 0x563007ed86e0 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd520031020 con 0x563007ed86e0 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 10 client.4728 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 10 client.4728 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 20 client.4728 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007ef1730 0x563007ef3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 4 client.4728 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.661+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 --> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563007e05c30 con 0x563007ef1730 2024-03-19T06:07:59.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.662+0000 7fd526a00640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007ef1730 0x563007ef3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.666+0000 7fd526a00640 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007ef1730 0x563007ef3b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7e9b5532197a4c server_cookie=609cdca8b243ad8d in_seq=0 out_seq=0 2024-03-19T06:07:59.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.666+0000 7fd50be00640 10 client.4728 ms_handle_connect on v2:172.21.15.17:6838/3325197099 2024-03-19T06:07:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.690+0000 7fd50be00640 1 -- 172.21.15.17:0/3056171543 <== mds.0 v2:172.21.15.17:6838/3325197099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563007e05c30 con 0x563007ef1730 2024-03-19T06:07:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.690+0000 7fd50be00640 10 client.4728 handle_command_reply: tid=0 2024-03-19T06:07:59.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.690+0000 7fd5307ce740 1 client.4728 shutdown 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 msgr2=0x563007eaf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd520004700 tx=0x7fd520004730 comp rx=0 tx=0).stop 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 shutdown_connections 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007ef1730 0x563007ef3b20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007ed86e0 0x563007eaf080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007eafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 --2- 172.21.15.17:0/3056171543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007e94040 0x563007eadf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 >> 172.21.15.17:0/3056171543 conn(0x563007e92aa0 msgr2=0x563007ed5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd50be00640 0 client.4728 ms_handle_reset on v2:172.21.15.17:6838/3325197099 2024-03-19T06:07:59.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 shutdown_connections 2024-03-19T06:07:59.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.691+0000 7fd5307ce740 1 -- 172.21.15.17:0/3056171543 wait complete. 2024-03-19T06:07:59.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.692+0000 7fd5307ce740 20 client.4728 trim_cache size 0 max 16384 2024-03-19T06:07:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.719+0000 7fd5307ce740 1 Processor -- start 2024-03-19T06:07:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.719+0000 7fd5307ce740 1 -- start start 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007ed86e0 0x563007ed2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007ed27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5280b4140 con 0x563007e94040 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007eada90 con 0x563007ed86e0 2024-03-19T06:07:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.721+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x563007ee5750 con 0x563007eddec0 2024-03-19T06:07:59.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.722+0000 7fd526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.722+0000 7fd526a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57176/0 (socket says 172.21.15.17:57176) 2024-03-19T06:07:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.722+0000 7fd526a00640 1 -- 172.21.15.17:0/4028150238 learned_addr learned my addr 172.21.15.17:0/4028150238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.723+0000 7fd526000640 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007ed86e0 0x563007ed2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.723+0000 7fd527400640 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007ed27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.726+0000 7fd526a00640 1 -- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 msgr2=0x563007ed27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.726+0000 7fd526a00640 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007ed27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.726+0000 7fd526a00640 1 -- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007ed86e0 msgr2=0x563007ed2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.726+0000 7fd526a00640 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007ed86e0 0x563007ed2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.726+0000 7fd526a00640 1 -- 172.21.15.17:0/4028150238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563007e95630 con 0x563007e94040 2024-03-19T06:07:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.729+0000 7fd526a00640 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd51805ae50 tx=0x7fd518013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922ff925ce5ed87b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.737+0000 7fd516a00640 1 -- 172.21.15.17:0/4028150238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51805c440 con 0x563007e94040 2024-03-19T06:07:59.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.737+0000 7fd516a00640 1 -- 172.21.15.17:0/4028150238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518058f70 con 0x563007e94040 2024-03-19T06:07:59.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.737+0000 7fd516a00640 1 -- 172.21.15.17:0/4028150238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51805c6d0 con 0x563007e94040 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 -- 172.21.15.17:0/4028150238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 msgr2=0x563007ee4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd51805ae50 tx=0x7fd518013000 comp rx=0 tx=0).stop 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 -- 172.21.15.17:0/4028150238 shutdown_connections 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007eddec0 0x563007ed27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007ed86e0 0x563007ed2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 --2- 172.21.15.17:0/4028150238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e94040 0x563007ee4c60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 -- 172.21.15.17:0/4028150238 >> 172.21.15.17:0/4028150238 conn(0x563007e92aa0 msgr2=0x563007e89920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 -- 172.21.15.17:0/4028150238 shutdown_connections 2024-03-19T06:07:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.738+0000 7fd5307ce740 1 -- 172.21.15.17:0/4028150238 wait complete. 2024-03-19T06:07:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.740+0000 7fd5307ce740 1 -- start start 2024-03-19T06:07:59.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.740+0000 7fd5307ce740 1 Processor -- start 2024-03-19T06:07:59.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007ed86e0 0x563007f43530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007ed2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007edd340 con 0x563007e8d9f0 2024-03-19T06:07:59.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563007ead770 con 0x563007eddec0 2024-03-19T06:07:59.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x563007ee84f0 con 0x563007ed86e0 2024-03-19T06:07:59.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.742+0000 7fd5307ce740 10 client.0 _ll_register_callbacks cb 0x7fd5100096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-19T06:07:59.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.743+0000 7fd527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.743+0000 7fd527400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57190/0 (socket says 172.21.15.17:57190) 2024-03-19T06:07:59.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.743+0000 7fd527400640 1 -- 172.21.15.17:0/310853674 learned_addr learned my addr 172.21.15.17:0/310853674 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:07:59.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.743+0000 7fd526000640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007ed2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.744+0000 7fd526a00640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007ed86e0 0x563007f43530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.749+0000 7fd527400640 1 -- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007ed86e0 msgr2=0x563007f43530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.749+0000 7fd527400640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007ed86e0 0x563007f43530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.749+0000 7fd527400640 1 -- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 msgr2=0x563007ed2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:07:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.749+0000 7fd527400640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007ed2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.749+0000 7fd527400640 1 -- 172.21.15.17:0/310853674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563007f43a70 con 0x563007e8d9f0 2024-03-19T06:07:59.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.753+0000 7fd527400640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b750 tx=0x7fd520015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d19b3e0b07b988c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:07:59.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.753+0000 7fd50be00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-19T06:07:59.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.760+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52001c050 con 0x563007e8d9f0 2024-03-19T06:07:59.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.760+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd520005ba0 con 0x563007e8d9f0 2024-03-19T06:07:59.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.760+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd518058f70 con 0x563007e8d9f0 2024-03-19T06:07:59.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.763+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd520040050 con 0x563007e8d9f0 2024-03-19T06:07:59.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.763+0000 7fd5307ce740 10 client.4734 fetch_fsmap learned FSMap version 20 2024-03-19T06:07:59.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.763+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x563007ed5460 con 0x563007e8d9f0 2024-03-19T06:07:59.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd518058f70 con 0x563007e8d9f0 2024-03-19T06:07:59.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 20) v1 ==== 4500+0+0 (secure 0 0 0) 0x7fd520043020 con 0x563007e8d9f0 2024-03-19T06:07:59.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 10 client.4734 fetch_fsmap finished waiting for FSMap version 20 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 10 client.4734 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 20 client.4734 populate_metadata read hostname 'smithi017' 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007f4a830 0x563007f4cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 4 client.4734 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.770+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 --> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563007dfff80 con 0x563007f4a830 2024-03-19T06:07:59.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.771+0000 7fd526a00640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007f4a830 0x563007f4cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:07:59.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.777+0000 7fd526a00640 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007f4a830 0x563007f4cc20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10a3520a62316941 server_cookie=f077392684b9016c in_seq=0 out_seq=0 2024-03-19T06:07:59.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.777+0000 7fd50be00640 10 client.4734 ms_handle_connect on v2:172.21.15.17:6838/3325197099 2024-03-19T06:07:59.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd50be00640 1 -- 172.21.15.17:0/310853674 <== mds.0 v2:172.21.15.17:6838/3325197099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563007dfff80 con 0x563007f4a830 2024-03-19T06:07:59.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd50be00640 10 client.4734 handle_command_reply: tid=0 2024-03-19T06:07:59.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 client.4734 shutdown 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 msgr2=0x563007f39cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b750 tx=0x7fd520015000 comp rx=0 tx=0).stop 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 shutdown_connections 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:6838/3325197099,v1:172.21.15.17:6839/3325197099] conn(0x563007f4a830 0x563007f4cc20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x563007e8d9f0 0x563007f39cd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563007eddec0 0x563007ed2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 --2- 172.21.15.17:0/310853674 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x563007ed86e0 0x563007f43530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd50be00640 0 client.4734 ms_handle_reset on v2:172.21.15.17:6838/3325197099 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.785+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 >> 172.21.15.17:0/310853674 conn(0x563007e92aa0 msgr2=0x563007e898b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.786+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 shutdown_connections 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.786+0000 7fd5307ce740 1 -- 172.21.15.17:0/310853674 wait complete. 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.786+0000 7fd5307ce740 20 client.4734 trim_cache size 0 max 16384 2024-03-19T06:07:59.777 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "b76b09f0-0b97-45ba-8841-90df0fadb075", 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4279, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 83.136607983999994, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 20, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 32, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 32, 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 98.116386965000004 2024-03-19T06:07:59.778 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:07:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.787+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 msgr2=0x7fd50406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.787+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 0x7fd50406e110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b400 tx=0x7fd52000b390 comp rx=0 tx=0).stop 2024-03-19T06:07:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.787+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 msgr2=0x7fd5280cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:07:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.787+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd518007f20 tx=0x7fd51800e570 comp rx=0 tx=0).stop 2024-03-19T06:07:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 shutdown_connections 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd5281541d0 0x7fd52814de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd50406bc50 0x7fd50406e110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5280cb8d0 0x7fd52815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 --2- 172.21.15.17:0/3997510685 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5280cb2d0 0x7fd5280cdc20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 >> 172.21.15.17:0/3997510685 conn(0x7fd52806baf0 msgr2=0x7fd5280b44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 shutdown_connections 2024-03-19T06:07:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:07:59.788+0000 7fd52da00640 1 -- 172.21.15.17:0/3997510685 wait complete. 2024-03-19T06:07:59.807 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-19T06:07:59.823 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-19T06:07:59.824 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-19T06:07:59.824 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-03-19T06:07:59.824 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-19T06:07:59.824 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:07:59.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:07:59.824 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-19T06:07:59.883 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-19T06:07:59.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:07:59.885 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-19T06:07:59.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:07:59.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-19T06:08:00.096 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-19T06:08:00.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-19T06:08:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.295+0000 7f4b30c00640 1 Processor -- start 2024-03-19T06:08:00.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.295+0000 7f4b30c00640 1 -- start start 2024-03-19T06:08:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.297+0000 7f4b30c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b2c15aa00 0x7f4b2c0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.297+0000 7f4b30c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c1542b0 con 0x7f4b2c0c6720 2024-03-19T06:08:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.297+0000 7f4b30c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c15d5c0 con 0x7f4b2c153ed0 2024-03-19T06:08:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.297+0000 7f4b30c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c15e1d0 con 0x7f4b2c15aa00 2024-03-19T06:08:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.298+0000 7f4b23e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4b2c15aa00 0x7f4b2c0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.298+0000 7f4b2a800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4b2c0c6720 0x7f4b2c070d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49068/0 (socket says 172.21.15.17:49068) 2024-03-19T06:08:00.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.298+0000 7f4b2a800640 1 -- 172.21.15.17:0/3672429222 learned_addr learned my addr 172.21.15.17:0/3672429222 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:08:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.301+0000 7f4b23e00640 1 -- 172.21.15.17:0/3672429222 >> v1:172.21.15.153:6789/0 conn(0x7f4b2c153ed0 legacy=0x7f4b2c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.302+0000 7f4b23e00640 1 -- 172.21.15.17:0/3672429222 >> v1:172.21.15.17:6789/0 conn(0x7f4b2c0c6720 legacy=0x7f4b2c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.302+0000 7f4b23e00640 1 -- 172.21.15.17:0/3672429222 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c15d8a0 con 0x7f4b2c15aa00 2024-03-19T06:08:00.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.306+0000 7f4b23e00640 1 --2- 172.21.15.17:0/3672429222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c0c61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b140097a0 tx=0x7f4b1402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688c84692061b4d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.313+0000 7f4b29400640 1 -- 172.21.15.17:0/3672429222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402f810 con 0x7f4b2c15aa00 2024-03-19T06:08:00.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.313+0000 7f4b29400640 1 -- 172.21.15.17:0/3672429222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1402f9b0 con 0x7f4b2c15aa00 2024-03-19T06:08:00.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.313+0000 7f4b29400640 1 -- 172.21.15.17:0/3672429222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402fd80 con 0x7f4b2c15aa00 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.313+0000 7f4b30c00640 1 -- 172.21.15.17:0/3672429222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c15aa00 msgr2=0x7f4b2c0c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.313+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3672429222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c0c61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4b140097a0 tx=0x7f4b1402b9f0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.314+0000 7f4b30c00640 1 -- 172.21.15.17:0/3672429222 shutdown_connections 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.314+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3672429222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c0c61e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.314+0000 7f4b30c00640 1 -- 172.21.15.17:0/3672429222 >> 172.21.15.17:0/3672429222 conn(0x7f4b2c0c8910 msgr2=0x7f4b2c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.314+0000 7f4b30c00640 1 -- 172.21.15.17:0/3672429222 shutdown_connections 2024-03-19T06:08:00.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.314+0000 7f4b30c00640 1 -- 172.21.15.17:0/3672429222 wait complete. 2024-03-19T06:08:00.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.317+0000 7f4b30c00640 1 Processor -- start 2024-03-19T06:08:00.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.317+0000 7f4b30c00640 1 -- start start 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4b2c0c6720 0x7f4b2c1e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c1e4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c06ee30 con 0x7f4b2c153ed0 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c15de60 con 0x7f4b2c15aa00 2024-03-19T06:08:00.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.319+0000 7f4b30c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c06efb0 con 0x7f4b2c0c6720 2024-03-19T06:08:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.320+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.320+0000 7f4b23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56682/0 (socket says 172.21.15.17:56682) 2024-03-19T06:08:00.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.320+0000 7f4b23e00640 1 -- 172.21.15.17:0/3136402748 learned_addr learned my addr 172.21.15.17:0/3136402748 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:08:00.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.321+0000 7f4b2a800640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c1e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.321+0000 7f4b29e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4b2c0c6720 0x7f4b2c1e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.324+0000 7f4b23e00640 1 -- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4b2c0c6720 msgr2=0x7f4b2c1e3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.324+0000 7f4b23e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4b2c0c6720 0x7f4b2c1e3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.324+0000 7f4b23e00640 1 -- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c15aa00 msgr2=0x7f4b2c1e4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.324+0000 7f4b23e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c1e4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.324+0000 7f4b23e00640 1 -- 172.21.15.17:0/3136402748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c1e4fb0 con 0x7f4b2c153ed0 2024-03-19T06:08:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.327+0000 7f4b23e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b1402c000 tx=0x7f4b14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.333+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14047070 con 0x7f4b2c153ed0 2024-03-19T06:08:00.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.334+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b14037c60 con 0x7f4b2c153ed0 2024-03-19T06:08:00.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.334+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1402fe60 con 0x7f4b2c153ed0 2024-03-19T06:08:00.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.334+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c1e5290 con 0x7f4b2c153ed0 2024-03-19T06:08:00.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.334+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c1e3320 con 0x7f4b2c153ed0 2024-03-19T06:08:00.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.335+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0c4260 con 0x7f4b2c153ed0 2024-03-19T06:08:00.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.621+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4b1404a070 con 0x7f4b2c153ed0 2024-03-19T06:08:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.624+0000 7f4b22000640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 0x7f4b0806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:08:00.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.624+0000 7f4b29e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 0x7f4b0806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:08:00.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.625+0000 7f4b29e00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 0x7f4b0806e0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c000f60 tx=0x7f4b1c009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:08:00.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.637+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4b14079110 con 0x7f4b2c153ed0 2024-03-19T06:08:00.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.639+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4b2c0c4260 con 0x7f4b2c153ed0 2024-03-19T06:08:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.891+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4b2c069be0 con 0x7f4b2c153ed0 2024-03-19T06:08:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.950+0000 7f4b22000640 1 -- 172.21.15.17:0/3136402748 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4b14051020 con 0x7f4b2c153ed0 2024-03-19T06:08:00.941 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 msgr2=0x7f4b0806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 0x7f4b0806e0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c000f60 tx=0x7f4b1c009040 comp rx=0 tx=0).stop 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 msgr2=0x7f4b2c1545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4b1402c000 tx=0x7f4b14004730 comp rx=0 tx=0).stop 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 shutdown_connections 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4b0806bc20 0x7f4b0806e0e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c15aa00 0x7f4b2c1e4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b2c153ed0 0x7f4b2c1545b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 --2- 172.21.15.17:0/3136402748 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4b2c0c6720 0x7f4b2c1e3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:08:00.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.954+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 >> 172.21.15.17:0/3136402748 conn(0x7f4b2c0c8910 msgr2=0x7f4b2c0c4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:08:00.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.955+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 shutdown_connections 2024-03-19T06:08:00.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:00.955+0000 7f4b30c00640 1 -- 172.21.15.17:0/3136402748 wait complete. 2024-03-19T06:08:00.966 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-19T06:08:00.966 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-19T06:08:00.966 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-19T06:08:00.967 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:08:00.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:00.967 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:08:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42015sec preferred_lft 42015sec 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-19T06:08:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-19T06:08:01.021 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-19T06:08:01.021 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-19T06:08:01.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.021 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:08:01.021 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:08:01.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-03-19T06:08:01.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-03-19T06:08:01.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-03-19T06:08:01.022 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-19T06:08:01.022 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:08:01.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.254 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-19T06:08:01.338 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-19T06:08:01.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.343 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-19T06:08:01.395 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-19T06:08:01.395 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-19T06:08:01.395 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-19T06:08:01.395 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-19T06:08:01.395 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-19T06:08:01.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-19T06:08:01.396 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:08:01.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.589 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-19T06:08:01.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.647 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-03-19T06:08:01.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.703 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:08:01.703 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:08:01.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:01.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-19T06:08:01.703 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:08:01.849 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-19T06:08:01.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:01.849 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:08:01.849 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:08:01.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-19T06:08:01.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-19T06:08:01.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-19T06:08:01.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-19T06:08:01.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-19T06:08:01.850 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:08:02.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:02.112 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-19T06:08:02.112 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-19T06:08:02.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-19T06:08:02.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-03-19T06:08:02.112 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-19T06:08:02.272 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-03-19T06:08:02.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:08:02.272 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:02.320 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-19T06:08:02.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-19T06:08:02.320 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:02.363 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-19T06:08:02.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:02.505 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:02.559 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:02.560 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:02.561 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:02.561 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:02.561 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:02.561 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:02.562 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:02.563 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:02.563 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:02.563 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:02.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:02.564 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:02.614 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-19T06:08:02.614 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-19T06:08:02.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:02.691 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:02.735 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:02.736 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:02.737 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:02.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:02.738 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:03.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:04.025 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:04.075 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:04.075 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:04.075 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:04.076 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:04.077 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:04.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:04.078 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:05.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:05.316 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:05.369 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:05.369 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:05.369 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:05.369 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:05.369 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:05.370 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:05.371 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:05.372 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:05.373 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:05.373 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:05.373 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:05.373 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:05.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:05.374 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:06.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:06.599 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:06.641 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:06.642 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:06.643 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:06.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:06.644 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:07.837 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:07.921 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:07.964 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:07.965 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:07.966 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:07.967 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:07.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:07.968 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:09.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:09.249 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:09.300 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:09.301 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:09.302 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:09.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:09.303 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:09.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[46330]: starting ceph client 2024-03-19T06:08:09.763 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-03-19T06:08:09.530+0000 650c100 -1 init, newargv = 0x7a35eb0 newargc=15 2024-03-19T06:08:10.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:10.549 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:10.599 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:10.599 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:10.599 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:10.600 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:10.601 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:10.602 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:10.602 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:10.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:10.603 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:11.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[46330]: starting fuse 2024-03-19T06:08:11.747 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-03-19T06:08:11.833 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-03-19T06:08:11.873 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-03-19T06:08:11.874 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-0 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-1 2024-03-19T06:08:11.875 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-2 2024-03-19T06:08:11.876 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph/osd/ceph-3 2024-03-19T06:08:11.876 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-03-19T06:08:11.876 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:11.876 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:08:11.876 INFO:teuthology.orchestra.run.smithi017.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:11.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:11.877 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-03-19T06:08:11.974 INFO:teuthology.orchestra.run.smithi017.stdout:41 2024-03-19T06:08:11.974 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-03-19T06:08:11.974 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-03-19T06:08:11.975 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-03-19T06:08:11.976 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-19T06:08:11.976 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-19T06:08:11.976 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-03-19T06:08:11.976 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-19T06:08:12.155 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.46330.asok 2024-03-19T06:08:12.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:08:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-19T06:08:12.174 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46330.asok 2024-03-19T06:08:12.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:12.175 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46330.asok status 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 19.0.0-1934-gb0ea271b (b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f) squid (dev)", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "46330", 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-03-19T06:08:12.587 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4752, 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 4752 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 573348383 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-03-19T06:08:12.588 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 573348383 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.4752 192.168.0.1:0/573348383", 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/573348383", 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 20, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 32, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-03-19T06:08:12.589 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:08:12.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:12.612 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-03-19T06:08:12.612 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.743 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-03-19T06:08:12.744 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:08:12.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.878 INFO:teuthology.run_tasks:Running task workunit... 2024-03-19T06:08:12.895 INFO:tasks.workunit:Pulling workunits from ref b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:08:12.895 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-19T06:08:12.895 INFO:tasks.workunit:timeout=3h 2024-03-19T06:08:12.895 INFO:tasks.workunit:cleanup=True 2024-03-19T06:08:12.896 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-19 06:06:37.011776389 +0000 2024-03-19T06:08:12.952 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-19 06:06:58.463264244 +0000 2024-03-19T06:08:12.953 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-03-19T06:08:12.953 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-19T06:08:12.953 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-19T06:08:14.358 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f 2024-03-19T06:08:14.418 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-19T06:08:18.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:08:18.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:08:48.459 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:08:48.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:09:18.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:09:18.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:09:36.532 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 60% (7385/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to 'b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f'. 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-03-19T06:09:37.094 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-03-19T06:09:37.095 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at b0ea271bb96 Merge PR #52373 into wip-vshankar-testing-20240307.022905 2024-03-19T06:09:37.103 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-19T06:09:37.163 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-19T06:09:37.171 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-19T06:09:37.171 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-19T06:09:37.948 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-19T06:09:38.074 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-19T06:09:38.165 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-19T06:09:38.172 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-19T06:09:38.173 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-19T06:09:38.253 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-19T06:09:38.263 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:09:38.263 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-19T06:09:38.316 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-03-19T06:09:38.317 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-03-19T06:09:38.317 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-03-19T06:09:39.055 INFO:tasks.workunit.client.0.smithi017.stderr:+ dbench 1 2024-03-19T06:09:39.071 INFO:tasks.workunit.client.0.smithi017.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-03-19T06:09:39.071 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:09:39.071 INFO:tasks.workunit.client.0.smithi017.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-03-19T06:09:39.081 INFO:tasks.workunit.client.0.smithi017.stdout:0 of 1 processes prepared for launch 0 sec 2024-03-19T06:09:39.181 INFO:tasks.workunit.client.0.smithi017.stdout:1 of 1 processes prepared for launch 0 sec 2024-03-19T06:09:39.182 INFO:tasks.workunit.client.0.smithi017.stdout:releasing clients 2024-03-19T06:09:40.182 INFO:tasks.workunit.client.0.smithi017.stdout: 0 7 0.00 MB/sec warmup 1 sec latency 42.767 ms 2024-03-19T06:09:41.182 INFO:tasks.workunit.client.0.smithi017.stdout: 0 10 0.00 MB/sec warmup 2 sec latency 544.170 ms 2024-03-19T06:09:42.182 INFO:tasks.workunit.client.0.smithi017.stdout: 1 31 0.35 MB/sec warmup 3 sec latency 244.017 ms 2024-03-19T06:09:43.182 INFO:tasks.workunit.client.0.smithi017.stdout: 1 51 0.52 MB/sec warmup 4 sec latency 628.469 ms 2024-03-19T06:09:44.182 INFO:tasks.workunit.client.0.smithi017.stdout: 1 86 0.79 MB/sec warmup 5 sec latency 539.941 ms 2024-03-19T06:09:45.182 INFO:tasks.workunit.client.0.smithi017.stdout: 1 111 0.87 MB/sec warmup 6 sec latency 546.529 ms 2024-03-19T06:09:46.182 INFO:tasks.workunit.client.0.smithi017.stdout: 1 121 0.79 MB/sec warmup 7 sec latency 419.277 ms 2024-03-19T06:09:47.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 137 0.75 MB/sec warmup 8 sec latency 549.160 ms 2024-03-19T06:09:48.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 145 0.69 MB/sec warmup 9 sec latency 591.354 ms 2024-03-19T06:09:48.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:09:48.743 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:09:49.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 155 0.65 MB/sec warmup 10 sec latency 634.022 ms 2024-03-19T06:09:50.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 165 0.62 MB/sec warmup 11 sec latency 453.830 ms 2024-03-19T06:09:51.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 181 0.61 MB/sec warmup 12 sec latency 649.291 ms 2024-03-19T06:09:52.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 189 0.58 MB/sec warmup 13 sec latency 530.179 ms 2024-03-19T06:09:53.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 199 0.56 MB/sec warmup 14 sec latency 561.499 ms 2024-03-19T06:09:54.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 215 0.56 MB/sec warmup 15 sec latency 569.141 ms 2024-03-19T06:09:55.183 INFO:tasks.workunit.client.0.smithi017.stdout: 1 223 0.54 MB/sec warmup 16 sec latency 593.512 ms 2024-03-19T06:09:56.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 239 0.54 MB/sec warmup 17 sec latency 547.749 ms 2024-03-19T06:09:57.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 247 0.52 MB/sec warmup 18 sec latency 617.649 ms 2024-03-19T06:09:58.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 263 0.52 MB/sec warmup 19 sec latency 706.909 ms 2024-03-19T06:09:59.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 271 0.51 MB/sec warmup 20 sec latency 513.376 ms 2024-03-19T06:10:00.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 287 0.51 MB/sec warmup 21 sec latency 637.686 ms 2024-03-19T06:10:01.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 297 0.50 MB/sec warmup 22 sec latency 451.102 ms 2024-03-19T06:10:02.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 305 0.49 MB/sec warmup 23 sec latency 677.240 ms 2024-03-19T06:10:03.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 315 0.48 MB/sec warmup 24 sec latency 655.023 ms 2024-03-19T06:10:04.184 INFO:tasks.workunit.client.0.smithi017.stdout: 1 331 0.48 MB/sec warmup 25 sec latency 577.235 ms 2024-03-19T06:10:05.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 339 0.47 MB/sec warmup 26 sec latency 567.082 ms 2024-03-19T06:10:06.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 349 0.46 MB/sec warmup 27 sec latency 588.417 ms 2024-03-19T06:10:07.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 364 0.47 MB/sec warmup 28 sec latency 674.369 ms 2024-03-19T06:10:08.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 373 0.46 MB/sec warmup 29 sec latency 500.886 ms 2024-03-19T06:10:09.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 389 0.46 MB/sec warmup 30 sec latency 523.302 ms 2024-03-19T06:10:10.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 405 0.46 MB/sec warmup 31 sec latency 574.801 ms 2024-03-19T06:10:11.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 413 0.46 MB/sec warmup 32 sec latency 609.232 ms 2024-03-19T06:10:12.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 429 0.46 MB/sec warmup 33 sec latency 625.303 ms 2024-03-19T06:10:13.185 INFO:tasks.workunit.client.0.smithi017.stdout: 1 437 0.45 MB/sec warmup 34 sec latency 581.853 ms 2024-03-19T06:10:14.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 445 0.45 MB/sec warmup 35 sec latency 1002.806 ms 2024-03-19T06:10:15.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 453 0.44 MB/sec warmup 36 sec latency 742.724 ms 2024-03-19T06:10:16.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 469 0.44 MB/sec warmup 37 sec latency 675.743 ms 2024-03-19T06:10:17.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 477 0.44 MB/sec warmup 38 sec latency 724.345 ms 2024-03-19T06:10:18.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 485 0.43 MB/sec warmup 39 sec latency 749.856 ms 2024-03-19T06:10:18.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:10:18.878 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:10:19.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 501 0.44 MB/sec warmup 40 sec latency 711.574 ms 2024-03-19T06:10:20.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 511 0.43 MB/sec warmup 41 sec latency 558.573 ms 2024-03-19T06:10:21.186 INFO:tasks.workunit.client.0.smithi017.stdout: 1 522 0.43 MB/sec warmup 42 sec latency 673.383 ms 2024-03-19T06:10:22.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 542 0.44 MB/sec warmup 43 sec latency 744.630 ms 2024-03-19T06:10:23.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 598 0.47 MB/sec warmup 44 sec latency 616.972 ms 2024-03-19T06:10:24.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 603 0.47 MB/sec warmup 45 sec latency 851.164 ms 2024-03-19T06:10:25.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 609 0.46 MB/sec warmup 46 sec latency 924.799 ms 2024-03-19T06:10:26.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 609 0.45 MB/sec warmup 47 sec latency 1191.410 ms 2024-03-19T06:10:27.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 614 0.44 MB/sec warmup 48 sec latency 1232.350 ms 2024-03-19T06:10:28.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 644 0.43 MB/sec warmup 49 sec latency 1259.111 ms 2024-03-19T06:10:29.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 644 0.42 MB/sec warmup 50 sec latency 1194.911 ms 2024-03-19T06:10:30.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 645 0.41 MB/sec warmup 51 sec latency 1462.624 ms 2024-03-19T06:10:31.187 INFO:tasks.workunit.client.0.smithi017.stdout: 1 651 0.41 MB/sec warmup 52 sec latency 1130.991 ms 2024-03-19T06:10:32.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 653 0.40 MB/sec warmup 53 sec latency 683.389 ms 2024-03-19T06:10:33.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 654 0.39 MB/sec warmup 54 sec latency 1154.641 ms 2024-03-19T06:10:34.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 664 0.38 MB/sec warmup 55 sec latency 712.888 ms 2024-03-19T06:10:35.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 680 0.38 MB/sec warmup 56 sec latency 218.616 ms 2024-03-19T06:10:36.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 680 0.37 MB/sec warmup 57 sec latency 1051.236 ms 2024-03-19T06:10:37.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 682 0.37 MB/sec warmup 58 sec latency 1270.896 ms 2024-03-19T06:10:38.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 699 0.36 MB/sec warmup 59 sec latency 1075.916 ms 2024-03-19T06:10:39.188 INFO:tasks.workunit.client.0.smithi017.stdout: 1 710 0.35 MB/sec warmup 60 sec latency 501.739 ms 2024-03-19T06:10:40.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 711 0.35 MB/sec warmup 61 sec latency 835.198 ms 2024-03-19T06:10:41.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 726 0.34 MB/sec warmup 62 sec latency 414.086 ms 2024-03-19T06:10:42.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 743 0.34 MB/sec warmup 63 sec latency 223.086 ms 2024-03-19T06:10:43.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 744 0.33 MB/sec warmup 64 sec latency 914.848 ms 2024-03-19T06:10:44.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 746 0.33 MB/sec warmup 65 sec latency 1468.232 ms 2024-03-19T06:10:45.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 747 0.32 MB/sec warmup 66 sec latency 1289.431 ms 2024-03-19T06:10:46.189 INFO:tasks.workunit.client.0.smithi017.stdout: 1 773 0.32 MB/sec warmup 67 sec latency 534.405 ms 2024-03-19T06:10:47.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 778 0.31 MB/sec warmup 68 sec latency 727.934 ms 2024-03-19T06:10:48.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 789 0.31 MB/sec warmup 69 sec latency 775.882 ms 2024-03-19T06:10:49.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:10:49.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:10:49.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 808 0.31 MB/sec warmup 70 sec latency 203.802 ms 2024-03-19T06:10:50.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 812 0.30 MB/sec warmup 71 sec latency 663.368 ms 2024-03-19T06:10:51.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 813 0.30 MB/sec warmup 72 sec latency 1150.592 ms 2024-03-19T06:10:52.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 815 0.29 MB/sec warmup 73 sec latency 1173.017 ms 2024-03-19T06:10:53.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 818 0.29 MB/sec warmup 74 sec latency 607.571 ms 2024-03-19T06:10:54.190 INFO:tasks.workunit.client.0.smithi017.stdout: 1 823 0.29 MB/sec warmup 75 sec latency 1291.274 ms 2024-03-19T06:10:55.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 846 0.28 MB/sec warmup 76 sec latency 1101.457 ms 2024-03-19T06:10:56.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 853 0.28 MB/sec warmup 77 sec latency 770.860 ms 2024-03-19T06:10:57.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 854 0.28 MB/sec warmup 78 sec latency 1098.502 ms 2024-03-19T06:10:58.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 857 0.27 MB/sec warmup 79 sec latency 1126.053 ms 2024-03-19T06:10:59.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 862 0.27 MB/sec warmup 80 sec latency 548.124 ms 2024-03-19T06:11:00.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 864 0.27 MB/sec warmup 81 sec latency 1094.446 ms 2024-03-19T06:11:01.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 880 0.26 MB/sec warmup 82 sec latency 317.079 ms 2024-03-19T06:11:02.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 885 0.26 MB/sec warmup 83 sec latency 1059.107 ms 2024-03-19T06:11:03.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 898 0.26 MB/sec warmup 84 sec latency 531.310 ms 2024-03-19T06:11:04.191 INFO:tasks.workunit.client.0.smithi017.stdout: 1 902 0.26 MB/sec warmup 85 sec latency 868.243 ms 2024-03-19T06:11:05.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 913 0.25 MB/sec warmup 86 sec latency 875.041 ms 2024-03-19T06:11:06.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 927 0.25 MB/sec warmup 87 sec latency 274.981 ms 2024-03-19T06:11:07.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 927 0.25 MB/sec warmup 88 sec latency 1094.182 ms 2024-03-19T06:11:08.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 928 0.24 MB/sec warmup 89 sec latency 1154.812 ms 2024-03-19T06:11:09.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 929 0.24 MB/sec warmup 90 sec latency 1304.431 ms 2024-03-19T06:11:10.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 931 0.24 MB/sec warmup 91 sec latency 649.733 ms 2024-03-19T06:11:11.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 933 0.24 MB/sec warmup 92 sec latency 1222.335 ms 2024-03-19T06:11:12.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 937 0.23 MB/sec warmup 93 sec latency 395.172 ms 2024-03-19T06:11:13.192 INFO:tasks.workunit.client.0.smithi017.stdout: 1 942 0.23 MB/sec warmup 94 sec latency 1079.034 ms 2024-03-19T06:11:14.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 942 0.23 MB/sec warmup 95 sec latency 1164.659 ms 2024-03-19T06:11:15.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 964 0.23 MB/sec warmup 96 sec latency 1358.217 ms 2024-03-19T06:11:16.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 969 0.22 MB/sec warmup 97 sec latency 759.664 ms 2024-03-19T06:11:17.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 980 0.22 MB/sec warmup 98 sec latency 787.058 ms 2024-03-19T06:11:18.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 994 0.22 MB/sec warmup 99 sec latency 246.438 ms 2024-03-19T06:11:19.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:11:19.170 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:11:19.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 994 0.22 MB/sec warmup 100 sec latency 1155.642 ms 2024-03-19T06:11:20.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1027 0.23 MB/sec warmup 101 sec latency 1182.380 ms 2024-03-19T06:11:21.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1028 0.22 MB/sec warmup 102 sec latency 1231.199 ms 2024-03-19T06:11:22.193 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1033 0.22 MB/sec warmup 103 sec latency 383.254 ms 2024-03-19T06:11:23.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1036 0.22 MB/sec warmup 104 sec latency 1051.610 ms 2024-03-19T06:11:24.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1046 0.22 MB/sec warmup 105 sec latency 509.662 ms 2024-03-19T06:11:25.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1046 0.22 MB/sec warmup 106 sec latency 1139.255 ms 2024-03-19T06:11:26.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1047 0.21 MB/sec warmup 107 sec latency 1311.640 ms 2024-03-19T06:11:27.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1048 0.21 MB/sec warmup 108 sec latency 1145.227 ms 2024-03-19T06:11:28.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1051 0.21 MB/sec warmup 109 sec latency 1135.664 ms 2024-03-19T06:11:29.194 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1060 0.21 MB/sec warmup 110 sec latency 442.225 ms 2024-03-19T06:11:30.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1064 0.21 MB/sec warmup 111 sec latency 464.580 ms 2024-03-19T06:11:31.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1084 0.20 MB/sec warmup 112 sec latency 446.850 ms 2024-03-19T06:11:32.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1088 0.20 MB/sec warmup 113 sec latency 848.185 ms 2024-03-19T06:11:33.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1099 0.20 MB/sec warmup 114 sec latency 1206.952 ms 2024-03-19T06:11:34.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1100 0.20 MB/sec warmup 115 sec latency 660.807 ms 2024-03-19T06:11:35.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1102 0.20 MB/sec warmup 116 sec latency 1327.306 ms 2024-03-19T06:11:36.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1114 0.20 MB/sec warmup 117 sec latency 393.291 ms 2024-03-19T06:11:37.195 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1117 0.19 MB/sec warmup 118 sec latency 1069.626 ms 2024-03-19T06:11:38.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1128 0.19 MB/sec warmup 119 sec latency 404.083 ms 2024-03-19T06:11:40.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1154 0.02 MB/sec execute 1 sec latency 668.150 ms 2024-03-19T06:11:41.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1157 0.01 MB/sec execute 2 sec latency 556.033 ms 2024-03-19T06:11:42.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1163 0.01 MB/sec execute 3 sec latency 1060.375 ms 2024-03-19T06:11:43.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1168 0.00 MB/sec execute 4 sec latency 731.204 ms 2024-03-19T06:11:44.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1169 0.00 MB/sec execute 5 sec latency 1515.666 ms 2024-03-19T06:11:45.196 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1170 0.00 MB/sec execute 6 sec latency 1152.536 ms 2024-03-19T06:11:46.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1170 0.00 MB/sec execute 7 sec latency 1063.367 ms 2024-03-19T06:11:47.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1176 0.00 MB/sec execute 8 sec latency 1127.539 ms 2024-03-19T06:11:48.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1180 0.00 MB/sec execute 9 sec latency 413.361 ms 2024-03-19T06:11:49.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1200 0.01 MB/sec execute 10 sec latency 390.567 ms 2024-03-19T06:11:49.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:11:49.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:11:50.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1204 0.01 MB/sec execute 11 sec latency 517.268 ms 2024-03-19T06:11:51.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1210 0.00 MB/sec execute 12 sec latency 1175.253 ms 2024-03-19T06:11:52.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1215 0.00 MB/sec execute 13 sec latency 345.314 ms 2024-03-19T06:11:53.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1231 0.01 MB/sec execute 14 sec latency 410.186 ms 2024-03-19T06:11:54.197 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1244 0.01 MB/sec execute 15 sec latency 523.149 ms 2024-03-19T06:11:55.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1248 0.01 MB/sec execute 16 sec latency 604.043 ms 2024-03-19T06:11:56.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1251 0.01 MB/sec execute 17 sec latency 1162.206 ms 2024-03-19T06:11:57.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1263 0.01 MB/sec execute 18 sec latency 403.845 ms 2024-03-19T06:11:58.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1278 0.01 MB/sec execute 19 sec latency 247.294 ms 2024-03-19T06:11:59.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1278 0.01 MB/sec execute 20 sec latency 1247.452 ms 2024-03-19T06:12:00.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1280 0.01 MB/sec execute 21 sec latency 1374.798 ms 2024-03-19T06:12:01.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1281 0.01 MB/sec execute 22 sec latency 1084.835 ms 2024-03-19T06:12:02.198 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1284 0.01 MB/sec execute 23 sec latency 1135.051 ms 2024-03-19T06:12:03.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1318 0.05 MB/sec execute 24 sec latency 1161.296 ms 2024-03-19T06:12:04.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1376 0.12 MB/sec execute 25 sec latency 897.064 ms 2024-03-19T06:12:05.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1377 0.12 MB/sec execute 26 sec latency 1470.793 ms 2024-03-19T06:12:06.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1378 0.11 MB/sec execute 27 sec latency 1092.097 ms 2024-03-19T06:12:07.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1381 0.11 MB/sec execute 28 sec latency 696.340 ms 2024-03-19T06:12:08.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1385 0.10 MB/sec execute 29 sec latency 1080.743 ms 2024-03-19T06:12:09.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1391 0.10 MB/sec execute 30 sec latency 1044.935 ms 2024-03-19T06:12:10.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1397 0.10 MB/sec execute 31 sec latency 388.431 ms 2024-03-19T06:12:11.199 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1397 0.09 MB/sec execute 32 sec latency 1049.459 ms 2024-03-19T06:12:12.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1410 0.09 MB/sec execute 33 sec latency 1150.161 ms 2024-03-19T06:12:13.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1417 0.09 MB/sec execute 34 sec latency 787.284 ms 2024-03-19T06:12:14.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1419 0.09 MB/sec execute 35 sec latency 1175.381 ms 2024-03-19T06:12:15.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1429 0.08 MB/sec execute 36 sec latency 511.072 ms 2024-03-19T06:12:16.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1446 0.08 MB/sec execute 37 sec latency 291.540 ms 2024-03-19T06:12:17.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1448 0.08 MB/sec execute 38 sec latency 551.221 ms 2024-03-19T06:12:18.200 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1457 0.08 MB/sec execute 39 sec latency 1087.872 ms 2024-03-19T06:12:19.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1464 0.08 MB/sec execute 40 sec latency 375.576 ms 2024-03-19T06:12:19.423 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:12:19.431 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:12:20.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1466 0.07 MB/sec execute 41 sec latency 670.180 ms 2024-03-19T06:12:21.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1481 0.07 MB/sec execute 42 sec latency 1080.811 ms 2024-03-19T06:12:22.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1485 0.07 MB/sec execute 43 sec latency 914.925 ms 2024-03-19T06:12:23.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1489 0.07 MB/sec execute 44 sec latency 1027.988 ms 2024-03-19T06:12:24.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1490 0.07 MB/sec execute 45 sec latency 683.884 ms 2024-03-19T06:12:25.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1499 0.07 MB/sec execute 46 sec latency 1147.570 ms 2024-03-19T06:12:26.201 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1504 0.06 MB/sec execute 47 sec latency 519.433 ms 2024-03-19T06:12:27.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1516 0.06 MB/sec execute 48 sec latency 585.601 ms 2024-03-19T06:12:28.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1526 0.06 MB/sec execute 49 sec latency 508.115 ms 2024-03-19T06:12:29.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1526 0.06 MB/sec execute 50 sec latency 1018.051 ms 2024-03-19T06:12:30.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1530 0.06 MB/sec execute 51 sec latency 1308.284 ms 2024-03-19T06:12:31.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1544 0.06 MB/sec execute 52 sec latency 1075.973 ms 2024-03-19T06:12:32.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1554 0.06 MB/sec execute 53 sec latency 581.727 ms 2024-03-19T06:12:33.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1555 0.06 MB/sec execute 54 sec latency 907.957 ms 2024-03-19T06:12:34.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1566 0.06 MB/sec execute 55 sec latency 1077.485 ms 2024-03-19T06:12:35.202 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1578 0.06 MB/sec execute 56 sec latency 251.822 ms 2024-03-19T06:12:36.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1586 0.06 MB/sec execute 57 sec latency 223.524 ms 2024-03-19T06:12:37.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1589 0.05 MB/sec execute 58 sec latency 455.605 ms 2024-03-19T06:12:38.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1599 0.05 MB/sec execute 59 sec latency 1238.135 ms 2024-03-19T06:12:39.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1606 0.05 MB/sec execute 60 sec latency 631.963 ms 2024-03-19T06:12:40.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1607 0.05 MB/sec execute 61 sec latency 1037.905 ms 2024-03-19T06:12:41.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1610 0.05 MB/sec execute 62 sec latency 822.807 ms 2024-03-19T06:12:42.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1615 0.05 MB/sec execute 63 sec latency 1061.698 ms 2024-03-19T06:12:43.203 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1617 0.05 MB/sec execute 64 sec latency 615.241 ms 2024-03-19T06:12:44.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1632 0.05 MB/sec execute 65 sec latency 1213.468 ms 2024-03-19T06:12:45.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1641 0.05 MB/sec execute 66 sec latency 646.623 ms 2024-03-19T06:12:46.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1643 0.05 MB/sec execute 67 sec latency 1078.568 ms 2024-03-19T06:12:47.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1644 0.05 MB/sec execute 68 sec latency 978.854 ms 2024-03-19T06:12:48.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1653 0.05 MB/sec execute 69 sec latency 1179.314 ms 2024-03-19T06:12:49.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1664 0.05 MB/sec execute 70 sec latency 716.849 ms 2024-03-19T06:12:49.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:12:49.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:12:50.204 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1686 0.05 MB/sec execute 71 sec latency 524.604 ms 2024-03-19T06:12:51.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1689 0.04 MB/sec execute 72 sec latency 833.160 ms 2024-03-19T06:12:52.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1699 0.04 MB/sec execute 73 sec latency 702.198 ms 2024-03-19T06:12:53.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1701 0.04 MB/sec execute 74 sec latency 797.714 ms 2024-03-19T06:12:54.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1707 0.04 MB/sec execute 75 sec latency 1069.074 ms 2024-03-19T06:12:55.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1717 0.04 MB/sec execute 76 sec latency 1150.292 ms 2024-03-19T06:12:56.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1727 0.04 MB/sec execute 77 sec latency 398.288 ms 2024-03-19T06:12:57.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1758 0.04 MB/sec execute 78 sec latency 218.298 ms 2024-03-19T06:12:58.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1770 0.04 MB/sec execute 79 sec latency 441.409 ms 2024-03-19T06:12:59.205 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1772 0.04 MB/sec execute 80 sec latency 787.154 ms 2024-03-19T06:13:00.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1783 0.04 MB/sec execute 81 sec latency 1260.350 ms 2024-03-19T06:13:01.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1802 0.04 MB/sec execute 82 sec latency 198.729 ms 2024-03-19T06:13:02.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1806 0.04 MB/sec execute 83 sec latency 364.019 ms 2024-03-19T06:13:03.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1806 0.04 MB/sec execute 84 sec latency 1210.016 ms 2024-03-19T06:13:04.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1820 0.04 MB/sec execute 85 sec latency 1215.119 ms 2024-03-19T06:13:05.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1822 0.04 MB/sec execute 86 sec latency 793.806 ms 2024-03-19T06:13:06.206 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1826 0.04 MB/sec execute 87 sec latency 1114.585 ms 2024-03-19T06:13:07.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1830 0.04 MB/sec execute 88 sec latency 1076.228 ms 2024-03-19T06:13:08.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1838 0.04 MB/sec execute 89 sec latency 239.497 ms 2024-03-19T06:13:09.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1841 0.04 MB/sec execute 90 sec latency 449.288 ms 2024-03-19T06:13:10.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1854 0.04 MB/sec execute 91 sec latency 1122.775 ms 2024-03-19T06:13:11.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1858 0.04 MB/sec execute 92 sec latency 537.636 ms 2024-03-19T06:13:12.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1862 0.04 MB/sec execute 93 sec latency 1079.481 ms 2024-03-19T06:13:13.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1862 0.04 MB/sec execute 94 sec latency 1022.580 ms 2024-03-19T06:13:14.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1868 0.04 MB/sec execute 95 sec latency 1046.831 ms 2024-03-19T06:13:15.207 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1869 0.04 MB/sec execute 96 sec latency 747.446 ms 2024-03-19T06:13:16.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1887 0.03 MB/sec execute 97 sec latency 1099.998 ms 2024-03-19T06:13:17.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1898 0.03 MB/sec execute 98 sec latency 672.030 ms 2024-03-19T06:13:18.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1903 0.03 MB/sec execute 99 sec latency 1050.570 ms 2024-03-19T06:13:19.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1909 0.03 MB/sec execute 100 sec latency 1043.767 ms 2024-03-19T06:13:19.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:13:19.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:13:20.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1912 0.03 MB/sec execute 101 sec latency 470.769 ms 2024-03-19T06:13:21.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1920 0.03 MB/sec execute 102 sec latency 982.369 ms 2024-03-19T06:13:22.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1920 0.03 MB/sec execute 103 sec latency 1113.890 ms 2024-03-19T06:13:23.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1956 0.03 MB/sec execute 104 sec latency 1209.597 ms 2024-03-19T06:13:24.208 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1973 0.03 MB/sec execute 105 sec latency 291.524 ms 2024-03-19T06:13:25.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1975 0.03 MB/sec execute 106 sec latency 540.432 ms 2024-03-19T06:13:26.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1982 0.03 MB/sec execute 107 sec latency 1073.803 ms 2024-03-19T06:13:27.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1997 0.03 MB/sec execute 108 sec latency 233.964 ms 2024-03-19T06:13:28.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 1997 0.03 MB/sec execute 109 sec latency 1089.451 ms 2024-03-19T06:13:29.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2004 0.03 MB/sec execute 110 sec latency 1359.073 ms 2024-03-19T06:13:30.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2016 0.03 MB/sec execute 111 sec latency 190.965 ms 2024-03-19T06:13:31.209 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2030 0.03 MB/sec execute 112 sec latency 196.894 ms 2024-03-19T06:13:32.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2034 0.03 MB/sec execute 113 sec latency 476.514 ms 2024-03-19T06:13:33.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2042 0.03 MB/sec execute 114 sec latency 1164.595 ms 2024-03-19T06:13:34.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2043 0.03 MB/sec execute 115 sec latency 855.061 ms 2024-03-19T06:13:35.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2051 0.03 MB/sec execute 116 sec latency 1503.610 ms 2024-03-19T06:13:36.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2053 0.03 MB/sec execute 117 sec latency 1076.073 ms 2024-03-19T06:13:37.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2053 0.03 MB/sec execute 118 sec latency 1019.664 ms 2024-03-19T06:13:38.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2059 0.03 MB/sec execute 119 sec latency 1041.788 ms 2024-03-19T06:13:39.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2061 0.03 MB/sec execute 120 sec latency 625.652 ms 2024-03-19T06:13:40.210 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2075 0.03 MB/sec execute 121 sec latency 1251.455 ms 2024-03-19T06:13:41.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2079 0.03 MB/sec execute 122 sec latency 917.201 ms 2024-03-19T06:13:42.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2081 0.03 MB/sec execute 123 sec latency 1329.890 ms 2024-03-19T06:13:43.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2088 0.03 MB/sec execute 124 sec latency 1203.988 ms 2024-03-19T06:13:44.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2093 0.03 MB/sec execute 125 sec latency 447.867 ms 2024-03-19T06:13:45.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2096 0.03 MB/sec execute 126 sec latency 1114.921 ms 2024-03-19T06:13:46.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2098 0.03 MB/sec execute 127 sec latency 1189.696 ms 2024-03-19T06:13:47.211 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2137 0.03 MB/sec execute 128 sec latency 191.264 ms 2024-03-19T06:13:48.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2140 0.03 MB/sec execute 129 sec latency 547.264 ms 2024-03-19T06:13:49.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2140 0.03 MB/sec execute 130 sec latency 1182.026 ms 2024-03-19T06:13:49.845 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:13:49.857 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:13:50.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2146 0.03 MB/sec execute 131 sec latency 1235.636 ms 2024-03-19T06:13:51.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2164 0.03 MB/sec execute 132 sec latency 996.558 ms 2024-03-19T06:13:52.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2173 0.03 MB/sec execute 133 sec latency 781.856 ms 2024-03-19T06:13:53.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2175 0.03 MB/sec execute 134 sec latency 1303.794 ms 2024-03-19T06:13:54.212 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2175 0.03 MB/sec execute 135 sec latency 1296.788 ms 2024-03-19T06:13:55.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2180 0.03 MB/sec execute 136 sec latency 1457.851 ms 2024-03-19T06:13:56.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2183 0.03 MB/sec execute 137 sec latency 507.377 ms 2024-03-19T06:13:57.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2198 0.03 MB/sec execute 138 sec latency 1108.551 ms 2024-03-19T06:13:58.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2201 0.03 MB/sec execute 139 sec latency 499.664 ms 2024-03-19T06:13:59.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2221 0.03 MB/sec execute 140 sec latency 342.369 ms 2024-03-19T06:14:00.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2221 0.03 MB/sec execute 141 sec latency 1060.533 ms 2024-03-19T06:14:01.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2258 0.03 MB/sec execute 142 sec latency 1073.545 ms 2024-03-19T06:14:02.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2273 0.03 MB/sec execute 143 sec latency 246.581 ms 2024-03-19T06:14:03.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2292 0.03 MB/sec execute 144 sec latency 792.582 ms 2024-03-19T06:14:04.213 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2298 0.03 MB/sec execute 145 sec latency 1104.809 ms 2024-03-19T06:14:05.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2303 0.03 MB/sec execute 146 sec latency 318.011 ms 2024-03-19T06:14:06.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2306 0.03 MB/sec execute 147 sec latency 1072.742 ms 2024-03-19T06:14:07.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2306 0.03 MB/sec execute 148 sec latency 1202.314 ms 2024-03-19T06:14:08.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2307 0.03 MB/sec execute 149 sec latency 1670.992 ms 2024-03-19T06:14:09.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2307 0.03 MB/sec execute 150 sec latency 1531.546 ms 2024-03-19T06:14:10.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2321 0.03 MB/sec execute 151 sec latency 1651.419 ms 2024-03-19T06:14:11.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2324 0.03 MB/sec execute 152 sec latency 1076.818 ms 2024-03-19T06:14:12.214 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2333 0.03 MB/sec execute 153 sec latency 1096.473 ms 2024-03-19T06:14:13.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2335 0.03 MB/sec execute 154 sec latency 552.857 ms 2024-03-19T06:14:14.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2340 0.03 MB/sec execute 155 sec latency 1057.048 ms 2024-03-19T06:14:15.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2340 0.03 MB/sec execute 156 sec latency 1014.013 ms 2024-03-19T06:14:16.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2353 0.03 MB/sec execute 157 sec latency 1200.624 ms 2024-03-19T06:14:17.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2361 0.03 MB/sec execute 158 sec latency 424.738 ms 2024-03-19T06:14:18.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2361 0.03 MB/sec execute 159 sec latency 1171.277 ms 2024-03-19T06:14:19.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2362 0.03 MB/sec execute 160 sec latency 1313.253 ms 2024-03-19T06:14:19.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:14:19.984 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:14:20.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2364 0.03 MB/sec execute 161 sec latency 1494.622 ms 2024-03-19T06:14:21.215 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2366 0.03 MB/sec execute 162 sec latency 975.660 ms 2024-03-19T06:14:22.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2367 0.03 MB/sec execute 163 sec latency 1194.682 ms 2024-03-19T06:14:23.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2371 0.03 MB/sec execute 164 sec latency 502.443 ms 2024-03-19T06:14:24.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2378 0.03 MB/sec execute 165 sec latency 1240.298 ms 2024-03-19T06:14:25.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2388 0.03 MB/sec execute 166 sec latency 596.598 ms 2024-03-19T06:14:26.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2391 0.03 MB/sec execute 167 sec latency 729.243 ms 2024-03-19T06:14:27.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2396 0.03 MB/sec execute 168 sec latency 1100.254 ms 2024-03-19T06:14:28.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2400 0.03 MB/sec execute 169 sec latency 435.516 ms 2024-03-19T06:14:29.216 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2407 0.03 MB/sec execute 170 sec latency 491.256 ms 2024-03-19T06:14:30.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2410 0.03 MB/sec execute 171 sec latency 902.834 ms 2024-03-19T06:14:31.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2426 0.03 MB/sec execute 172 sec latency 1119.573 ms 2024-03-19T06:14:32.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2431 0.03 MB/sec execute 173 sec latency 668.984 ms 2024-03-19T06:14:33.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2432 0.03 MB/sec execute 174 sec latency 1132.912 ms 2024-03-19T06:14:34.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2432 0.03 MB/sec execute 175 sec latency 1036.095 ms 2024-03-19T06:14:35.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2436 0.03 MB/sec execute 176 sec latency 1250.370 ms 2024-03-19T06:14:36.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2441 0.03 MB/sec execute 177 sec latency 486.847 ms 2024-03-19T06:14:37.217 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2449 0.03 MB/sec execute 178 sec latency 406.499 ms 2024-03-19T06:14:38.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2454 0.03 MB/sec execute 179 sec latency 525.268 ms 2024-03-19T06:14:39.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2467 0.03 MB/sec execute 180 sec latency 452.867 ms 2024-03-19T06:14:40.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2470 0.03 MB/sec execute 181 sec latency 830.828 ms 2024-03-19T06:14:41.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2487 0.03 MB/sec execute 182 sec latency 1038.802 ms 2024-03-19T06:14:41.315 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:10.314 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:41.557 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:10.556 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:41.586 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:09:10.602 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:41.588 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:10.604 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:41.713 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:09:10.729 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:41.718 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:10.734 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:42.131 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:09:11.130 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:42.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2492 0.03 MB/sec execute 183 sec latency 787.846 ms 2024-03-19T06:14:42.226 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:09:11.241 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:42.227 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:09:11.243 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:14:43.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2494 0.03 MB/sec execute 184 sec latency 1000.555 ms 2024-03-19T06:14:44.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2494 0.03 MB/sec execute 185 sec latency 1063.491 ms 2024-03-19T06:14:45.218 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2499 0.03 MB/sec execute 186 sec latency 1505.009 ms 2024-03-19T06:14:46.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2506 0.03 MB/sec execute 187 sec latency 213.098 ms 2024-03-19T06:14:47.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2549 0.03 MB/sec execute 188 sec latency 1081.608 ms 2024-03-19T06:14:48.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2549 0.03 MB/sec execute 189 sec latency 1034.639 ms 2024-03-19T06:14:49.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2551 0.03 MB/sec execute 190 sec latency 1071.857 ms 2024-03-19T06:14:50.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:14:50.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:14:50.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2559 0.03 MB/sec execute 191 sec latency 1090.913 ms 2024-03-19T06:14:51.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2560 0.03 MB/sec execute 192 sec latency 748.837 ms 2024-03-19T06:14:52.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2567 0.03 MB/sec execute 193 sec latency 1126.102 ms 2024-03-19T06:14:53.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2576 0.03 MB/sec execute 194 sec latency 451.367 ms 2024-03-19T06:14:54.219 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2580 0.03 MB/sec execute 195 sec latency 710.022 ms 2024-03-19T06:14:55.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2581 0.03 MB/sec execute 196 sec latency 1174.456 ms 2024-03-19T06:14:56.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2583 0.03 MB/sec execute 197 sec latency 1064.238 ms 2024-03-19T06:14:57.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2596 0.03 MB/sec execute 198 sec latency 369.060 ms 2024-03-19T06:14:58.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2600 0.03 MB/sec execute 199 sec latency 833.441 ms 2024-03-19T06:14:59.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2601 0.03 MB/sec execute 200 sec latency 1372.318 ms 2024-03-19T06:15:00.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2607 0.03 MB/sec execute 201 sec latency 342.429 ms 2024-03-19T06:15:01.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2615 0.03 MB/sec execute 202 sec latency 441.447 ms 2024-03-19T06:15:02.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2615 0.03 MB/sec execute 203 sec latency 1080.219 ms 2024-03-19T06:15:03.220 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2617 0.03 MB/sec execute 204 sec latency 1127.717 ms 2024-03-19T06:15:04.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2618 0.03 MB/sec execute 205 sec latency 1098.384 ms 2024-03-19T06:15:05.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2621 0.03 MB/sec execute 206 sec latency 1168.381 ms 2024-03-19T06:15:06.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2655 0.03 MB/sec execute 207 sec latency 1084.365 ms 2024-03-19T06:15:07.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2718 0.04 MB/sec execute 208 sec latency 715.732 ms 2024-03-19T06:15:08.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2723 0.04 MB/sec execute 209 sec latency 1245.986 ms 2024-03-19T06:15:09.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2745 0.04 MB/sec execute 210 sec latency 997.498 ms 2024-03-19T06:15:10.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2752 0.04 MB/sec execute 211 sec latency 1237.909 ms 2024-03-19T06:15:11.221 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2760 0.04 MB/sec execute 212 sec latency 595.734 ms 2024-03-19T06:15:12.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2762 0.04 MB/sec execute 213 sec latency 1117.848 ms 2024-03-19T06:15:13.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2770 0.04 MB/sec execute 214 sec latency 346.543 ms 2024-03-19T06:15:14.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2779 0.04 MB/sec execute 215 sec latency 426.909 ms 2024-03-19T06:15:15.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2780 0.04 MB/sec execute 216 sec latency 804.259 ms 2024-03-19T06:15:16.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2797 0.04 MB/sec execute 217 sec latency 1086.627 ms 2024-03-19T06:15:17.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2872 0.04 MB/sec execute 218 sec latency 833.402 ms 2024-03-19T06:15:18.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2879 0.04 MB/sec execute 219 sec latency 1116.809 ms 2024-03-19T06:15:19.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2881 0.04 MB/sec execute 220 sec latency 512.944 ms 2024-03-19T06:15:20.222 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2898 0.04 MB/sec execute 221 sec latency 366.590 ms 2024-03-19T06:15:20.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:15:20.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:15:21.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2903 0.04 MB/sec execute 222 sec latency 471.909 ms 2024-03-19T06:15:22.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2918 0.05 MB/sec execute 223 sec latency 448.548 ms 2024-03-19T06:15:23.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2931 0.05 MB/sec execute 224 sec latency 301.404 ms 2024-03-19T06:15:24.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2936 0.05 MB/sec execute 225 sec latency 693.954 ms 2024-03-19T06:15:25.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2938 0.05 MB/sec execute 226 sec latency 832.314 ms 2024-03-19T06:15:26.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2966 0.05 MB/sec execute 227 sec latency 1231.032 ms 2024-03-19T06:15:27.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2967 0.05 MB/sec execute 228 sec latency 1165.979 ms 2024-03-19T06:15:28.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2974 0.05 MB/sec execute 229 sec latency 311.264 ms 2024-03-19T06:15:29.223 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2974 0.05 MB/sec execute 230 sec latency 1030.166 ms 2024-03-19T06:15:30.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2977 0.05 MB/sec execute 231 sec latency 1541.237 ms 2024-03-19T06:15:31.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2984 0.05 MB/sec execute 232 sec latency 343.161 ms 2024-03-19T06:15:32.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2993 0.05 MB/sec execute 233 sec latency 412.624 ms 2024-03-19T06:15:33.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 2994 0.04 MB/sec execute 234 sec latency 816.828 ms 2024-03-19T06:15:34.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3006 0.04 MB/sec execute 235 sec latency 1015.453 ms 2024-03-19T06:15:35.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3012 0.04 MB/sec execute 236 sec latency 658.849 ms 2024-03-19T06:15:36.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3019 0.04 MB/sec execute 237 sec latency 680.062 ms 2024-03-19T06:15:37.224 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3024 0.04 MB/sec execute 238 sec latency 442.903 ms 2024-03-19T06:15:38.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3031 0.04 MB/sec execute 239 sec latency 547.365 ms 2024-03-19T06:15:39.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3167 0.05 MB/sec execute 240 sec latency 1154.497 ms 2024-03-19T06:15:40.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3167 0.05 MB/sec execute 241 sec latency 1199.830 ms 2024-03-19T06:15:41.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3171 0.05 MB/sec execute 242 sec latency 1363.203 ms 2024-03-19T06:15:42.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3177 0.05 MB/sec execute 243 sec latency 491.149 ms 2024-03-19T06:15:43.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3188 0.05 MB/sec execute 244 sec latency 777.691 ms 2024-03-19T06:15:44.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3190 0.05 MB/sec execute 245 sec latency 1236.764 ms 2024-03-19T06:15:45.225 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3207 0.05 MB/sec execute 246 sec latency 349.085 ms 2024-03-19T06:15:46.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3212 0.05 MB/sec execute 247 sec latency 703.225 ms 2024-03-19T06:15:47.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3246 0.05 MB/sec execute 248 sec latency 396.484 ms 2024-03-19T06:15:48.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3266 0.05 MB/sec execute 249 sec latency 684.880 ms 2024-03-19T06:15:49.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3268 0.05 MB/sec execute 250 sec latency 1220.699 ms 2024-03-19T06:15:50.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3271 0.05 MB/sec execute 251 sec latency 1219.041 ms 2024-03-19T06:15:50.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:15:50.413 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:15:51.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3280 0.05 MB/sec execute 252 sec latency 311.141 ms 2024-03-19T06:15:52.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3281 0.05 MB/sec execute 253 sec latency 1046.862 ms 2024-03-19T06:15:53.226 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3281 0.05 MB/sec execute 254 sec latency 1247.560 ms 2024-03-19T06:15:54.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3282 0.05 MB/sec execute 255 sec latency 1293.188 ms 2024-03-19T06:15:55.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3283 0.05 MB/sec execute 256 sec latency 1301.186 ms 2024-03-19T06:15:56.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3285 0.05 MB/sec execute 257 sec latency 1081.063 ms 2024-03-19T06:15:57.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3286 0.05 MB/sec execute 258 sec latency 1089.457 ms 2024-03-19T06:15:58.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3287 0.05 MB/sec execute 259 sec latency 1141.526 ms 2024-03-19T06:15:59.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3290 0.05 MB/sec execute 260 sec latency 1134.066 ms 2024-03-19T06:16:00.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3290 0.05 MB/sec execute 261 sec latency 1080.073 ms 2024-03-19T06:16:01.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3291 0.05 MB/sec execute 262 sec latency 1122.584 ms 2024-03-19T06:16:02.227 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3292 0.05 MB/sec execute 263 sec latency 1050.995 ms 2024-03-19T06:16:03.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3293 0.05 MB/sec execute 264 sec latency 1046.730 ms 2024-03-19T06:16:04.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3294 0.05 MB/sec execute 265 sec latency 1070.685 ms 2024-03-19T06:16:05.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3295 0.05 MB/sec execute 266 sec latency 1060.187 ms 2024-03-19T06:16:06.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3298 0.05 MB/sec execute 267 sec latency 1048.073 ms 2024-03-19T06:16:07.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3299 0.05 MB/sec execute 268 sec latency 1043.778 ms 2024-03-19T06:16:08.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3303 0.05 MB/sec execute 269 sec latency 1066.290 ms 2024-03-19T06:16:09.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3306 0.05 MB/sec execute 270 sec latency 1042.134 ms 2024-03-19T06:16:10.228 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3307 0.05 MB/sec execute 271 sec latency 1041.881 ms 2024-03-19T06:16:11.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3307 0.05 MB/sec execute 272 sec latency 1017.467 ms 2024-03-19T06:16:12.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3308 0.05 MB/sec execute 273 sec latency 1061.403 ms 2024-03-19T06:16:13.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3309 0.05 MB/sec execute 274 sec latency 1069.173 ms 2024-03-19T06:16:14.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3310 0.04 MB/sec execute 275 sec latency 1098.112 ms 2024-03-19T06:16:15.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3311 0.04 MB/sec execute 276 sec latency 1078.452 ms 2024-03-19T06:16:16.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3312 0.04 MB/sec execute 277 sec latency 1071.711 ms 2024-03-19T06:16:17.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3313 0.04 MB/sec execute 278 sec latency 1097.603 ms 2024-03-19T06:16:18.229 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3314 0.04 MB/sec execute 279 sec latency 1091.113 ms 2024-03-19T06:16:19.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3316 0.04 MB/sec execute 280 sec latency 1087.932 ms 2024-03-19T06:16:20.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3317 0.04 MB/sec execute 281 sec latency 1069.096 ms 2024-03-19T06:16:20.537 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:16:20.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:16:21.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3318 0.04 MB/sec execute 282 sec latency 950.316 ms 2024-03-19T06:16:22.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3319 0.04 MB/sec execute 283 sec latency 1064.403 ms 2024-03-19T06:16:23.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3320 0.04 MB/sec execute 284 sec latency 1076.756 ms 2024-03-19T06:16:24.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3322 0.04 MB/sec execute 285 sec latency 1079.537 ms 2024-03-19T06:16:25.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3322 0.04 MB/sec execute 286 sec latency 1053.765 ms 2024-03-19T06:16:26.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3323 0.04 MB/sec execute 287 sec latency 1077.120 ms 2024-03-19T06:16:27.230 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3324 0.04 MB/sec execute 288 sec latency 1044.416 ms 2024-03-19T06:16:28.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3325 0.04 MB/sec execute 289 sec latency 1084.020 ms 2024-03-19T06:16:29.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3326 0.04 MB/sec execute 290 sec latency 1047.560 ms 2024-03-19T06:16:30.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3327 0.04 MB/sec execute 291 sec latency 1020.472 ms 2024-03-19T06:16:31.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3330 0.04 MB/sec execute 292 sec latency 1038.541 ms 2024-03-19T06:16:32.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3331 0.04 MB/sec execute 293 sec latency 1060.474 ms 2024-03-19T06:16:33.231 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3332 0.04 MB/sec execute 294 sec latency 1044.157 ms 2024-03-19T06:16:34.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3333 0.04 MB/sec execute 295 sec latency 1088.107 ms 2024-03-19T06:16:35.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3334 0.04 MB/sec execute 296 sec latency 1080.789 ms 2024-03-19T06:16:36.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3335 0.04 MB/sec execute 297 sec latency 1058.993 ms 2024-03-19T06:16:37.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3336 0.04 MB/sec execute 298 sec latency 1048.489 ms 2024-03-19T06:16:38.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3337 0.04 MB/sec execute 299 sec latency 1012.561 ms 2024-03-19T06:16:39.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3339 0.04 MB/sec execute 300 sec latency 1059.290 ms 2024-03-19T06:16:40.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3351 0.04 MB/sec execute 301 sec latency 306.579 ms 2024-03-19T06:16:41.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3357 0.04 MB/sec execute 302 sec latency 457.777 ms 2024-03-19T06:16:42.232 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3364 0.04 MB/sec execute 303 sec latency 362.537 ms 2024-03-19T06:16:43.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3367 0.04 MB/sec execute 304 sec latency 483.562 ms 2024-03-19T06:16:44.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3377 0.04 MB/sec execute 305 sec latency 373.921 ms 2024-03-19T06:16:45.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3381 0.04 MB/sec execute 306 sec latency 451.061 ms 2024-03-19T06:16:46.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3391 0.04 MB/sec execute 307 sec latency 609.017 ms 2024-03-19T06:16:47.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3393 0.04 MB/sec execute 308 sec latency 1294.476 ms 2024-03-19T06:16:48.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3395 0.04 MB/sec execute 309 sec latency 1207.569 ms 2024-03-19T06:16:48.454 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:17.454 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.488 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:17.487 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.514 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:11:17.530 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.518 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:17.534 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.523 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:11:17.540 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.527 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:17.544 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.655 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:11:17.672 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.697 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:11:17.713 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:48.817 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:11:17.816 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:16:49.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3395 0.04 MB/sec execute 310 sec latency 1054.092 ms 2024-03-19T06:16:50.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3398 0.04 MB/sec execute 311 sec latency 1649.992 ms 2024-03-19T06:16:50.668 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:16:50.680 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:16:51.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3432 0.04 MB/sec execute 312 sec latency 971.889 ms 2024-03-19T06:16:52.233 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3501 0.05 MB/sec execute 313 sec latency 352.937 ms 2024-03-19T06:16:53.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3513 0.05 MB/sec execute 314 sec latency 271.626 ms 2024-03-19T06:16:54.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3525 0.05 MB/sec execute 315 sec latency 376.460 ms 2024-03-19T06:16:55.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3531 0.05 MB/sec execute 316 sec latency 686.902 ms 2024-03-19T06:16:56.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3534 0.05 MB/sec execute 317 sec latency 1121.786 ms 2024-03-19T06:16:57.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3548 0.05 MB/sec execute 318 sec latency 447.285 ms 2024-03-19T06:16:58.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3556 0.05 MB/sec execute 319 sec latency 518.516 ms 2024-03-19T06:16:59.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3557 0.05 MB/sec execute 320 sec latency 928.211 ms 2024-03-19T06:17:00.234 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3558 0.05 MB/sec execute 321 sec latency 1654.398 ms 2024-03-19T06:17:01.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3563 0.05 MB/sec execute 322 sec latency 380.901 ms 2024-03-19T06:17:02.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3573 0.05 MB/sec execute 323 sec latency 540.839 ms 2024-03-19T06:17:03.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3579 0.05 MB/sec execute 324 sec latency 1123.432 ms 2024-03-19T06:17:04.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3588 0.05 MB/sec execute 325 sec latency 355.197 ms 2024-03-19T06:17:05.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3617 0.05 MB/sec execute 326 sec latency 1061.621 ms 2024-03-19T06:17:06.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3626 0.05 MB/sec execute 327 sec latency 491.437 ms 2024-03-19T06:17:07.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3633 0.05 MB/sec execute 328 sec latency 437.945 ms 2024-03-19T06:17:08.235 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3641 0.05 MB/sec execute 329 sec latency 420.203 ms 2024-03-19T06:17:09.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3642 0.05 MB/sec execute 330 sec latency 853.790 ms 2024-03-19T06:17:10.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3645 0.05 MB/sec execute 331 sec latency 1428.570 ms 2024-03-19T06:17:11.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3663 0.05 MB/sec execute 332 sec latency 310.276 ms 2024-03-19T06:17:12.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3671 0.05 MB/sec execute 333 sec latency 371.879 ms 2024-03-19T06:17:13.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3672 0.05 MB/sec execute 334 sec latency 795.709 ms 2024-03-19T06:17:14.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3674 0.05 MB/sec execute 335 sec latency 1167.680 ms 2024-03-19T06:17:15.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3683 0.05 MB/sec execute 336 sec latency 364.520 ms 2024-03-19T06:17:16.236 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3686 0.05 MB/sec execute 337 sec latency 739.680 ms 2024-03-19T06:17:17.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3691 0.05 MB/sec execute 338 sec latency 1093.004 ms 2024-03-19T06:17:18.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3696 0.05 MB/sec execute 339 sec latency 582.502 ms 2024-03-19T06:17:19.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3705 0.05 MB/sec execute 340 sec latency 430.559 ms 2024-03-19T06:17:20.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3715 0.05 MB/sec execute 341 sec latency 422.634 ms 2024-03-19T06:17:20.790 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:17:20.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:17:21.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3721 0.05 MB/sec execute 342 sec latency 310.026 ms 2024-03-19T06:17:22.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3758 0.05 MB/sec execute 343 sec latency 180.858 ms 2024-03-19T06:17:23.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3758 0.05 MB/sec execute 344 sec latency 1062.224 ms 2024-03-19T06:17:24.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3767 0.05 MB/sec execute 345 sec latency 1233.057 ms 2024-03-19T06:17:25.237 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3773 0.05 MB/sec execute 346 sec latency 597.706 ms 2024-03-19T06:17:26.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3776 0.05 MB/sec execute 347 sec latency 460.753 ms 2024-03-19T06:17:27.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3781 0.05 MB/sec execute 348 sec latency 470.828 ms 2024-03-19T06:17:28.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3785 0.05 MB/sec execute 349 sec latency 540.416 ms 2024-03-19T06:17:29.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3790 0.05 MB/sec execute 350 sec latency 661.415 ms 2024-03-19T06:17:30.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3790 0.05 MB/sec execute 351 sec latency 1059.240 ms 2024-03-19T06:17:31.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3792 0.05 MB/sec execute 352 sec latency 1106.067 ms 2024-03-19T06:17:32.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3796 0.05 MB/sec execute 353 sec latency 554.229 ms 2024-03-19T06:17:33.238 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3801 0.05 MB/sec execute 354 sec latency 684.640 ms 2024-03-19T06:17:34.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3805 0.05 MB/sec execute 355 sec latency 606.092 ms 2024-03-19T06:17:35.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3808 0.05 MB/sec execute 356 sec latency 486.132 ms 2024-03-19T06:17:36.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3814 0.05 MB/sec execute 357 sec latency 458.378 ms 2024-03-19T06:17:37.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3820 0.05 MB/sec execute 358 sec latency 346.938 ms 2024-03-19T06:17:38.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3824 0.05 MB/sec execute 359 sec latency 475.556 ms 2024-03-19T06:17:39.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3830 0.05 MB/sec execute 360 sec latency 497.417 ms 2024-03-19T06:17:40.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3835 0.05 MB/sec execute 361 sec latency 360.414 ms 2024-03-19T06:17:41.239 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3839 0.05 MB/sec execute 362 sec latency 470.367 ms 2024-03-19T06:17:42.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3844 0.05 MB/sec execute 363 sec latency 321.358 ms 2024-03-19T06:17:43.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3848 0.05 MB/sec execute 364 sec latency 487.629 ms 2024-03-19T06:17:44.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3854 0.05 MB/sec execute 365 sec latency 450.178 ms 2024-03-19T06:17:45.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3860 0.05 MB/sec execute 366 sec latency 332.300 ms 2024-03-19T06:17:46.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3864 0.05 MB/sec execute 367 sec latency 492.943 ms 2024-03-19T06:17:47.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3869 0.05 MB/sec execute 368 sec latency 522.071 ms 2024-03-19T06:17:48.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3870 0.05 MB/sec execute 369 sec latency 853.406 ms 2024-03-19T06:17:49.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3876 0.05 MB/sec execute 370 sec latency 1087.616 ms 2024-03-19T06:17:50.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3876 0.05 MB/sec execute 371 sec latency 1195.173 ms 2024-03-19T06:17:50.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:17:50.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:17:51.240 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3880 0.05 MB/sec execute 372 sec latency 1652.189 ms 2024-03-19T06:17:52.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3885 0.04 MB/sec execute 373 sec latency 505.981 ms 2024-03-19T06:17:53.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3896 0.05 MB/sec execute 374 sec latency 601.933 ms 2024-03-19T06:17:54.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3898 0.05 MB/sec execute 375 sec latency 1185.567 ms 2024-03-19T06:17:55.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3898 0.05 MB/sec execute 376 sec latency 1010.465 ms 2024-03-19T06:17:56.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3905 0.05 MB/sec execute 377 sec latency 1102.472 ms 2024-03-19T06:17:57.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3914 0.05 MB/sec execute 378 sec latency 659.814 ms 2024-03-19T06:17:58.241 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3920 0.05 MB/sec execute 379 sec latency 1077.343 ms 2024-03-19T06:17:59.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3923 0.04 MB/sec execute 380 sec latency 510.915 ms 2024-03-19T06:18:00.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3927 0.04 MB/sec execute 381 sec latency 522.555 ms 2024-03-19T06:18:01.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3932 0.04 MB/sec execute 382 sec latency 445.559 ms 2024-03-19T06:18:02.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3936 0.04 MB/sec execute 383 sec latency 543.796 ms 2024-03-19T06:18:03.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3938 0.04 MB/sec execute 384 sec latency 664.944 ms 2024-03-19T06:18:04.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3939 0.04 MB/sec execute 385 sec latency 642.391 ms 2024-03-19T06:18:05.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3944 0.04 MB/sec execute 386 sec latency 717.412 ms 2024-03-19T06:18:06.242 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3948 0.04 MB/sec execute 387 sec latency 580.380 ms 2024-03-19T06:18:07.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3952 0.04 MB/sec execute 388 sec latency 556.888 ms 2024-03-19T06:18:08.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3958 0.04 MB/sec execute 389 sec latency 591.724 ms 2024-03-19T06:18:09.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3961 0.04 MB/sec execute 390 sec latency 478.213 ms 2024-03-19T06:18:10.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3966 0.04 MB/sec execute 391 sec latency 419.847 ms 2024-03-19T06:18:11.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3970 0.04 MB/sec execute 392 sec latency 468.818 ms 2024-03-19T06:18:12.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3975 0.04 MB/sec execute 393 sec latency 456.941 ms 2024-03-19T06:18:13.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3982 0.04 MB/sec execute 394 sec latency 470.908 ms 2024-03-19T06:18:14.243 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3986 0.04 MB/sec execute 395 sec latency 484.294 ms 2024-03-19T06:18:15.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3991 0.04 MB/sec execute 396 sec latency 347.423 ms 2024-03-19T06:18:16.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 3995 0.04 MB/sec execute 397 sec latency 510.417 ms 2024-03-19T06:18:17.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4001 0.04 MB/sec execute 398 sec latency 475.661 ms 2024-03-19T06:18:18.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4006 0.04 MB/sec execute 399 sec latency 403.160 ms 2024-03-19T06:18:19.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4010 0.04 MB/sec execute 400 sec latency 424.836 ms 2024-03-19T06:18:20.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4015 0.04 MB/sec execute 401 sec latency 697.880 ms 2024-03-19T06:18:21.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:18:21.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:18:21.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4022 0.04 MB/sec execute 402 sec latency 350.862 ms 2024-03-19T06:18:22.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4026 0.04 MB/sec execute 403 sec latency 488.761 ms 2024-03-19T06:18:23.244 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4027 0.04 MB/sec execute 404 sec latency 961.576 ms 2024-03-19T06:18:24.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4031 0.04 MB/sec execute 405 sec latency 1104.170 ms 2024-03-19T06:18:25.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4032 0.04 MB/sec execute 406 sec latency 913.531 ms 2024-03-19T06:18:26.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4035 0.04 MB/sec execute 407 sec latency 1223.300 ms 2024-03-19T06:18:27.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4037 0.04 MB/sec execute 408 sec latency 1072.578 ms 2024-03-19T06:18:28.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4042 0.04 MB/sec execute 409 sec latency 198.559 ms 2024-03-19T06:18:29.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4047 0.04 MB/sec execute 410 sec latency 485.031 ms 2024-03-19T06:18:30.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4052 0.04 MB/sec execute 411 sec latency 1376.529 ms 2024-03-19T06:18:31.245 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4058 0.04 MB/sec execute 412 sec latency 842.597 ms 2024-03-19T06:18:32.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4061 0.04 MB/sec execute 413 sec latency 1069.849 ms 2024-03-19T06:18:33.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4066 0.04 MB/sec execute 414 sec latency 192.008 ms 2024-03-19T06:18:34.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4071 0.04 MB/sec execute 415 sec latency 411.652 ms 2024-03-19T06:18:35.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4082 0.04 MB/sec execute 416 sec latency 1054.801 ms 2024-03-19T06:18:36.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4085 0.04 MB/sec execute 417 sec latency 1023.482 ms 2024-03-19T06:18:37.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4094 0.04 MB/sec execute 418 sec latency 423.726 ms 2024-03-19T06:18:38.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4102 0.04 MB/sec execute 419 sec latency 577.446 ms 2024-03-19T06:18:39.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4112 0.04 MB/sec execute 420 sec latency 205.990 ms 2024-03-19T06:18:40.246 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4114 0.04 MB/sec execute 421 sec latency 858.871 ms 2024-03-19T06:18:41.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4120 0.04 MB/sec execute 422 sec latency 631.806 ms 2024-03-19T06:18:42.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4130 0.04 MB/sec execute 423 sec latency 214.740 ms 2024-03-19T06:18:43.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4138 0.04 MB/sec execute 424 sec latency 467.750 ms 2024-03-19T06:18:44.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4148 0.04 MB/sec execute 425 sec latency 238.293 ms 2024-03-19T06:18:45.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4153 0.04 MB/sec execute 426 sec latency 562.878 ms 2024-03-19T06:18:46.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4159 0.04 MB/sec execute 427 sec latency 962.951 ms 2024-03-19T06:18:47.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4162 0.04 MB/sec execute 428 sec latency 678.697 ms 2024-03-19T06:18:48.247 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4172 0.04 MB/sec execute 429 sec latency 850.788 ms 2024-03-19T06:18:49.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4173 0.04 MB/sec execute 430 sec latency 615.972 ms 2024-03-19T06:18:50.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4176 0.04 MB/sec execute 431 sec latency 1373.452 ms 2024-03-19T06:18:51.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:18:51.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:18:51.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4176 0.04 MB/sec execute 432 sec latency 1038.334 ms 2024-03-19T06:18:52.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4181 0.04 MB/sec execute 433 sec latency 1087.391 ms 2024-03-19T06:18:53.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4186 0.04 MB/sec execute 434 sec latency 1076.712 ms 2024-03-19T06:18:54.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4211 0.04 MB/sec execute 435 sec latency 1037.396 ms 2024-03-19T06:18:55.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4216 0.04 MB/sec execute 436 sec latency 794.618 ms 2024-03-19T06:18:56.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4217 0.04 MB/sec execute 437 sec latency 1212.055 ms 2024-03-19T06:18:57.248 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4223 0.04 MB/sec execute 438 sec latency 1028.101 ms 2024-03-19T06:18:58.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4225 0.04 MB/sec execute 439 sec latency 803.614 ms 2024-03-19T06:18:59.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4227 0.04 MB/sec execute 440 sec latency 1114.989 ms 2024-03-19T06:19:00.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4243 0.04 MB/sec execute 441 sec latency 337.228 ms 2024-03-19T06:19:01.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4252 0.04 MB/sec execute 442 sec latency 566.014 ms 2024-03-19T06:19:02.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4254 0.04 MB/sec execute 443 sec latency 1084.861 ms 2024-03-19T06:19:03.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4263 0.04 MB/sec execute 444 sec latency 1077.736 ms 2024-03-19T06:19:04.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4278 0.04 MB/sec execute 445 sec latency 432.516 ms 2024-03-19T06:19:05.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4282 0.04 MB/sec execute 446 sec latency 685.888 ms 2024-03-19T06:19:06.249 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4297 0.04 MB/sec execute 447 sec latency 372.530 ms 2024-03-19T06:19:07.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4314 0.04 MB/sec execute 448 sec latency 187.831 ms 2024-03-19T06:19:08.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4315 0.04 MB/sec execute 449 sec latency 965.196 ms 2024-03-19T06:19:09.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4317 0.04 MB/sec execute 450 sec latency 1189.186 ms 2024-03-19T06:19:10.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4338 0.04 MB/sec execute 451 sec latency 1118.811 ms 2024-03-19T06:19:11.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4349 0.04 MB/sec execute 452 sec latency 435.591 ms 2024-03-19T06:19:12.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4351 0.04 MB/sec execute 453 sec latency 651.597 ms 2024-03-19T06:19:13.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4369 0.04 MB/sec execute 454 sec latency 330.547 ms 2024-03-19T06:19:14.250 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4383 0.04 MB/sec execute 455 sec latency 198.890 ms 2024-03-19T06:19:15.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4383 0.04 MB/sec execute 456 sec latency 1155.535 ms 2024-03-19T06:19:16.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4384 0.04 MB/sec execute 457 sec latency 1158.579 ms 2024-03-19T06:19:17.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4388 0.04 MB/sec execute 458 sec latency 1002.473 ms 2024-03-19T06:19:18.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4393 0.04 MB/sec execute 459 sec latency 1115.215 ms 2024-03-19T06:19:19.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4419 0.04 MB/sec execute 460 sec latency 1048.518 ms 2024-03-19T06:19:20.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4423 0.04 MB/sec execute 461 sec latency 901.306 ms 2024-03-19T06:19:21.251 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4424 0.04 MB/sec execute 462 sec latency 1494.583 ms 2024-03-19T06:19:21.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:19:21.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:19:22.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4427 0.04 MB/sec execute 463 sec latency 976.095 ms 2024-03-19T06:19:23.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4432 0.04 MB/sec execute 464 sec latency 738.821 ms 2024-03-19T06:19:24.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4434 0.04 MB/sec execute 465 sec latency 1188.370 ms 2024-03-19T06:19:25.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4450 0.04 MB/sec execute 466 sec latency 324.330 ms 2024-03-19T06:19:26.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4452 0.04 MB/sec execute 467 sec latency 1098.241 ms 2024-03-19T06:19:27.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4468 0.04 MB/sec execute 468 sec latency 495.768 ms 2024-03-19T06:19:28.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4473 0.04 MB/sec execute 469 sec latency 815.286 ms 2024-03-19T06:19:29.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4485 0.04 MB/sec execute 470 sec latency 387.918 ms 2024-03-19T06:19:30.252 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4497 0.04 MB/sec execute 471 sec latency 301.418 ms 2024-03-19T06:19:31.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4497 0.04 MB/sec execute 472 sec latency 1114.186 ms 2024-03-19T06:19:32.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4498 0.04 MB/sec execute 473 sec latency 1475.496 ms 2024-03-19T06:19:33.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4499 0.04 MB/sec execute 474 sec latency 1113.150 ms 2024-03-19T06:19:34.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4501 0.04 MB/sec execute 475 sec latency 635.368 ms 2024-03-19T06:19:35.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4502 0.04 MB/sec execute 476 sec latency 1199.808 ms 2024-03-19T06:19:36.253 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4506 0.04 MB/sec execute 477 sec latency 331.098 ms 2024-03-19T06:19:37.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4511 0.04 MB/sec execute 478 sec latency 1093.493 ms 2024-03-19T06:19:38.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4518 0.04 MB/sec execute 479 sec latency 1054.566 ms 2024-03-19T06:19:39.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4538 0.04 MB/sec execute 480 sec latency 316.927 ms 2024-03-19T06:19:40.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4539 0.04 MB/sec execute 481 sec latency 911.312 ms 2024-03-19T06:19:41.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4549 0.04 MB/sec execute 482 sec latency 501.707 ms 2024-03-19T06:19:42.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4563 0.04 MB/sec execute 483 sec latency 241.744 ms 2024-03-19T06:19:43.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4564 0.04 MB/sec execute 484 sec latency 1094.460 ms 2024-03-19T06:19:44.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4596 0.04 MB/sec execute 485 sec latency 196.946 ms 2024-03-19T06:19:45.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4596 0.04 MB/sec execute 486 sec latency 1112.076 ms 2024-03-19T06:19:46.254 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4602 0.04 MB/sec execute 487 sec latency 1212.604 ms 2024-03-19T06:19:47.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4606 0.04 MB/sec execute 488 sec latency 1055.795 ms 2024-03-19T06:19:48.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4614 0.04 MB/sec execute 489 sec latency 481.077 ms 2024-03-19T06:19:49.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4615 0.04 MB/sec execute 490 sec latency 1083.939 ms 2024-03-19T06:19:50.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4615 0.04 MB/sec execute 491 sec latency 1397.384 ms 2024-03-19T06:19:51.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4616 0.04 MB/sec execute 492 sec latency 1524.646 ms 2024-03-19T06:19:51.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:19:51.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:19:52.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4627 0.04 MB/sec execute 493 sec latency 1162.360 ms 2024-03-19T06:19:53.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4630 0.04 MB/sec execute 494 sec latency 474.507 ms 2024-03-19T06:19:54.255 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4642 0.04 MB/sec execute 495 sec latency 424.621 ms 2024-03-19T06:19:55.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4656 0.04 MB/sec execute 496 sec latency 395.966 ms 2024-03-19T06:19:56.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4657 0.04 MB/sec execute 497 sec latency 1036.589 ms 2024-03-19T06:19:57.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4668 0.04 MB/sec execute 498 sec latency 363.551 ms 2024-03-19T06:19:58.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4670 0.04 MB/sec execute 499 sec latency 1065.545 ms 2024-03-19T06:19:59.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4681 0.04 MB/sec execute 500 sec latency 520.221 ms 2024-03-19T06:20:00.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4684 0.04 MB/sec execute 501 sec latency 1092.520 ms 2024-03-19T06:20:01.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4697 0.04 MB/sec execute 502 sec latency 381.664 ms 2024-03-19T06:20:02.256 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4714 0.04 MB/sec execute 503 sec latency 405.103 ms 2024-03-19T06:20:03.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4723 0.04 MB/sec execute 504 sec latency 693.195 ms 2024-03-19T06:20:04.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4724 0.04 MB/sec execute 505 sec latency 676.530 ms 2024-03-19T06:20:05.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4729 0.04 MB/sec execute 506 sec latency 1077.335 ms 2024-03-19T06:20:06.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4734 0.04 MB/sec execute 507 sec latency 679.209 ms 2024-03-19T06:20:07.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4735 0.04 MB/sec execute 508 sec latency 1178.422 ms 2024-03-19T06:20:08.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4736 0.04 MB/sec execute 509 sec latency 1223.159 ms 2024-03-19T06:20:09.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4738 0.04 MB/sec execute 510 sec latency 1262.861 ms 2024-03-19T06:20:10.257 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4742 0.04 MB/sec execute 511 sec latency 513.688 ms 2024-03-19T06:20:11.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4746 0.04 MB/sec execute 512 sec latency 484.847 ms 2024-03-19T06:20:12.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4764 0.04 MB/sec execute 513 sec latency 396.531 ms 2024-03-19T06:20:13.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4770 0.04 MB/sec execute 514 sec latency 469.083 ms 2024-03-19T06:20:14.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4773 0.04 MB/sec execute 515 sec latency 1134.852 ms 2024-03-19T06:20:15.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4780 0.04 MB/sec execute 516 sec latency 488.147 ms 2024-03-19T06:20:16.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4791 0.04 MB/sec execute 517 sec latency 640.984 ms 2024-03-19T06:20:17.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4806 0.04 MB/sec execute 518 sec latency 411.072 ms 2024-03-19T06:20:18.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4814 0.04 MB/sec execute 519 sec latency 639.681 ms 2024-03-19T06:20:19.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4814 0.04 MB/sec execute 520 sec latency 1084.422 ms 2024-03-19T06:20:20.258 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4821 0.04 MB/sec execute 521 sec latency 1136.714 ms 2024-03-19T06:20:21.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4844 0.04 MB/sec execute 522 sec latency 211.370 ms 2024-03-19T06:20:21.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:21.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:22.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4844 0.04 MB/sec execute 523 sec latency 1007.826 ms 2024-03-19T06:20:23.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4846 0.04 MB/sec execute 524 sec latency 1135.817 ms 2024-03-19T06:20:24.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4847 0.04 MB/sec execute 525 sec latency 1175.688 ms 2024-03-19T06:20:25.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4850 0.04 MB/sec execute 526 sec latency 1100.584 ms 2024-03-19T06:20:26.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4850 0.04 MB/sec execute 527 sec latency 1554.751 ms 2024-03-19T06:20:27.259 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4942 0.04 MB/sec execute 528 sec latency 1632.255 ms 2024-03-19T06:20:28.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4943 0.04 MB/sec execute 529 sec latency 1075.527 ms 2024-03-19T06:20:29.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4944 0.04 MB/sec execute 530 sec latency 1104.483 ms 2024-03-19T06:20:30.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4947 0.04 MB/sec execute 531 sec latency 550.066 ms 2024-03-19T06:20:31.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4951 0.04 MB/sec execute 532 sec latency 1115.225 ms 2024-03-19T06:20:32.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4953 0.04 MB/sec execute 533 sec latency 1048.220 ms 2024-03-19T06:20:33.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4962 0.04 MB/sec execute 534 sec latency 184.231 ms 2024-03-19T06:20:34.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4963 0.04 MB/sec execute 535 sec latency 751.512 ms 2024-03-19T06:20:35.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4969 0.04 MB/sec execute 536 sec latency 1135.161 ms 2024-03-19T06:20:36.260 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4983 0.04 MB/sec execute 537 sec latency 819.078 ms 2024-03-19T06:20:37.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4984 0.04 MB/sec execute 538 sec latency 1089.257 ms 2024-03-19T06:20:38.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 4994 0.04 MB/sec execute 539 sec latency 525.402 ms 2024-03-19T06:20:39.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5011 0.04 MB/sec execute 540 sec latency 461.432 ms 2024-03-19T06:20:40.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5014 0.04 MB/sec execute 541 sec latency 587.626 ms 2024-03-19T06:20:41.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5015 0.04 MB/sec execute 542 sec latency 1055.793 ms 2024-03-19T06:20:42.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5029 0.04 MB/sec execute 543 sec latency 249.961 ms 2024-03-19T06:20:43.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5032 0.04 MB/sec execute 544 sec latency 429.745 ms 2024-03-19T06:20:44.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5044 0.04 MB/sec execute 545 sec latency 1133.603 ms 2024-03-19T06:20:45.261 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5051 0.04 MB/sec execute 546 sec latency 666.972 ms 2024-03-19T06:20:46.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5052 0.04 MB/sec execute 547 sec latency 1454.088 ms 2024-03-19T06:20:47.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5056 0.04 MB/sec execute 548 sec latency 430.326 ms 2024-03-19T06:20:48.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5056 0.04 MB/sec execute 549 sec latency 1004.420 ms 2024-03-19T06:20:49.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5065 0.04 MB/sec execute 550 sec latency 1175.435 ms 2024-03-19T06:20:50.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5075 0.04 MB/sec execute 551 sec latency 629.806 ms 2024-03-19T06:20:51.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5089 0.04 MB/sec execute 552 sec latency 512.684 ms 2024-03-19T06:20:51.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:51.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:20:52.262 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5092 0.04 MB/sec execute 553 sec latency 493.255 ms 2024-03-19T06:20:53.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5095 0.04 MB/sec execute 554 sec latency 1059.143 ms 2024-03-19T06:20:54.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5096 0.04 MB/sec execute 555 sec latency 995.817 ms 2024-03-19T06:20:55.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5118 0.04 MB/sec execute 556 sec latency 1047.205 ms 2024-03-19T06:20:56.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5120 0.04 MB/sec execute 557 sec latency 576.274 ms 2024-03-19T06:20:56.563 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:25.563 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.590 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:25.591 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.685 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:15:25.702 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.693 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:25.710 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.693 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:15:25.710 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.696 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:25.714 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.733 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:15:25.734 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.817 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:15:25.834 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:56.844 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:15:25.862 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:20:57.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5127 0.04 MB/sec execute 558 sec latency 1081.047 ms 2024-03-19T06:20:58.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5137 0.04 MB/sec execute 559 sec latency 208.118 ms 2024-03-19T06:20:59.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5149 0.04 MB/sec execute 560 sec latency 226.572 ms 2024-03-19T06:21:00.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5153 0.04 MB/sec execute 561 sec latency 297.620 ms 2024-03-19T06:21:01.263 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5154 0.04 MB/sec execute 562 sec latency 741.885 ms 2024-03-19T06:21:02.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5168 0.04 MB/sec execute 563 sec latency 1104.341 ms 2024-03-19T06:21:03.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5171 0.04 MB/sec execute 564 sec latency 521.332 ms 2024-03-19T06:21:04.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5175 0.04 MB/sec execute 565 sec latency 1100.494 ms 2024-03-19T06:21:05.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5177 0.04 MB/sec execute 566 sec latency 1107.380 ms 2024-03-19T06:21:06.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5181 0.04 MB/sec execute 567 sec latency 226.910 ms 2024-03-19T06:21:07.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5182 0.04 MB/sec execute 568 sec latency 882.112 ms 2024-03-19T06:21:08.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5206 0.04 MB/sec execute 569 sec latency 1059.198 ms 2024-03-19T06:21:09.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5206 0.04 MB/sec execute 570 sec latency 1010.043 ms 2024-03-19T06:21:10.264 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5209 0.04 MB/sec execute 571 sec latency 1097.378 ms 2024-03-19T06:21:11.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5211 0.04 MB/sec execute 572 sec latency 1254.208 ms 2024-03-19T06:21:12.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5225 0.04 MB/sec execute 573 sec latency 637.570 ms 2024-03-19T06:21:13.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5248 0.04 MB/sec execute 574 sec latency 495.990 ms 2024-03-19T06:21:14.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5254 0.04 MB/sec execute 575 sec latency 751.822 ms 2024-03-19T06:21:15.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5263 0.04 MB/sec execute 576 sec latency 719.105 ms 2024-03-19T06:21:16.265 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5266 0.04 MB/sec execute 577 sec latency 474.591 ms 2024-03-19T06:21:17.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5271 0.04 MB/sec execute 578 sec latency 1065.975 ms 2024-03-19T06:21:18.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5272 0.04 MB/sec execute 579 sec latency 945.068 ms 2024-03-19T06:21:19.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5278 0.04 MB/sec execute 580 sec latency 1468.562 ms 2024-03-19T06:21:20.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5288 0.04 MB/sec execute 581 sec latency 220.036 ms 2024-03-19T06:21:21.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5307 0.04 MB/sec execute 582 sec latency 221.627 ms 2024-03-19T06:21:21.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:21.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:22.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5335 0.04 MB/sec execute 583 sec latency 236.060 ms 2024-03-19T06:21:23.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5337 0.04 MB/sec execute 584 sec latency 575.629 ms 2024-03-19T06:21:24.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5344 0.04 MB/sec execute 585 sec latency 1099.076 ms 2024-03-19T06:21:25.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5366 0.04 MB/sec execute 586 sec latency 223.611 ms 2024-03-19T06:21:26.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5370 0.04 MB/sec execute 587 sec latency 315.513 ms 2024-03-19T06:21:27.266 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5371 0.04 MB/sec execute 588 sec latency 943.067 ms 2024-03-19T06:21:28.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5385 0.04 MB/sec execute 589 sec latency 1200.529 ms 2024-03-19T06:21:29.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5387 0.04 MB/sec execute 590 sec latency 689.238 ms 2024-03-19T06:21:30.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5391 0.04 MB/sec execute 591 sec latency 1044.392 ms 2024-03-19T06:21:31.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5395 0.04 MB/sec execute 592 sec latency 1147.270 ms 2024-03-19T06:21:32.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5403 0.04 MB/sec execute 593 sec latency 208.269 ms 2024-03-19T06:21:33.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5406 0.04 MB/sec execute 594 sec latency 396.200 ms 2024-03-19T06:21:34.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5417 0.04 MB/sec execute 595 sec latency 1142.912 ms 2024-03-19T06:21:35.267 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5423 0.04 MB/sec execute 596 sec latency 548.988 ms 2024-03-19T06:21:36.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5424 0.04 MB/sec execute 597 sec latency 1150.975 ms 2024-03-19T06:21:37.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5427 0.04 MB/sec execute 598 sec latency 876.836 ms 2024-03-19T06:21:38.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 5433 0.04 MB/sec execute 599 sec latency 971.243 ms 2024-03-19T06:21:39.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 600 sec 2024-03-19T06:21:40.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 601 sec 2024-03-19T06:21:41.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 602 sec 2024-03-19T06:21:42.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 603 sec 2024-03-19T06:21:43.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 604 sec 2024-03-19T06:21:44.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 605 sec 2024-03-19T06:21:45.268 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 606 sec 2024-03-19T06:21:46.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 607 sec 2024-03-19T06:21:47.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 608 sec 2024-03-19T06:21:48.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 609 sec 2024-03-19T06:21:49.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 610 sec 2024-03-19T06:21:50.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 611 sec 2024-03-19T06:21:51.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 612 sec 2024-03-19T06:21:52.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:52.101 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:21:52.269 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 613 sec 2024-03-19T06:21:53.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 614 sec 2024-03-19T06:21:54.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 615 sec 2024-03-19T06:21:55.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 616 sec 2024-03-19T06:21:56.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 617 sec 2024-03-19T06:21:57.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 618 sec 2024-03-19T06:21:58.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 619 sec 2024-03-19T06:21:59.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 620 sec 2024-03-19T06:22:00.270 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 621 sec 2024-03-19T06:22:01.095 INFO:tasks.workunit.client.0.smithi017.stdout: 0 cleanup 622 sec 2024-03-19T06:22:01.095 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:22:01.095 INFO:tasks.workunit.client.0.smithi017.stdout: Operation Count AvgLat MaxLat 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: ---------------------------------------- 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: NTCreateX 770 212.715 819.057 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Close 560 4.377 81.258 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Rename 31 596.749 911.283 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Unlink 136 204.087 522.525 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Qpathinfo 707 115.216 1106.046 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Qfileinfo 123 4.052 25.551 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Qfsinfo 109 25.038 191.604 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Sfileinfo 61 42.905 57.055 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: Find 254 1133.458 1670.964 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: WriteX 351 13.758 246.564 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: ReadX 1140 0.121 5.241 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: LockX 2 113.458 132.094 2024-03-19T06:22:01.096 INFO:tasks.workunit.client.0.smithi017.stdout: UnlockX 2 67.386 84.491 2024-03-19T06:22:01.097 INFO:tasks.workunit.client.0.smithi017.stdout: Flush 46 160.659 324.080 2024-03-19T06:22:01.097 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:22:01.097 INFO:tasks.workunit.client.0.smithi017.stdout:Throughput 0.037537 MB/sec 1 clients 1 procs max_latency=1670.992 ms 2024-03-19T06:22:01.097 INFO:tasks.workunit.client.0.smithi017.stderr:+ dbench 10 2024-03-19T06:22:01.099 INFO:tasks.workunit.client.0.smithi017.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-03-19T06:22:01.099 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:22:01.099 INFO:tasks.workunit.client.0.smithi017.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-03-19T06:22:01.103 INFO:tasks.workunit.client.0.smithi017.stdout:9 of 10 processes prepared for launch 0 sec 2024-03-19T06:22:01.203 INFO:tasks.workunit.client.0.smithi017.stdout:10 of 10 processes prepared for launch 0 sec 2024-03-19T06:22:01.204 INFO:tasks.workunit.client.0.smithi017.stdout:releasing clients 2024-03-19T06:22:02.204 INFO:tasks.workunit.client.0.smithi017.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.733 ms 2024-03-19T06:22:03.204 INFO:tasks.workunit.client.0.smithi017.stdout: 0 2 0.00 MB/sec warmup 2 sec latency 1999.905 ms 2024-03-19T06:22:04.204 INFO:tasks.workunit.client.0.smithi017.stdout: 0 2 0.00 MB/sec warmup 3 sec latency 3000.003 ms 2024-03-19T06:22:05.204 INFO:tasks.workunit.client.0.smithi017.stdout: 0 3 0.00 MB/sec warmup 4 sec latency 4000.114 ms 2024-03-19T06:22:06.205 INFO:tasks.workunit.client.0.smithi017.stdout: 0 4 0.00 MB/sec warmup 5 sec latency 5000.230 ms 2024-03-19T06:22:07.204 INFO:tasks.workunit.client.0.smithi017.stdout: 0 5 0.00 MB/sec warmup 6 sec latency 6000.365 ms 2024-03-19T06:22:08.205 INFO:tasks.workunit.client.0.smithi017.stdout: 0 6 0.00 MB/sec warmup 7 sec latency 7000.478 ms 2024-03-19T06:22:09.205 INFO:tasks.workunit.client.0.smithi017.stdout: 0 7 0.00 MB/sec warmup 8 sec latency 1455.460 ms 2024-03-19T06:22:10.205 INFO:tasks.workunit.client.0.smithi017.stdout: 0 8 0.00 MB/sec warmup 9 sec latency 1917.003 ms 2024-03-19T06:22:11.205 INFO:tasks.workunit.client.0.smithi017.stdout: 3 12 0.17 MB/sec warmup 10 sec latency 1738.781 ms 2024-03-19T06:22:12.205 INFO:tasks.workunit.client.0.smithi017.stdout: 3 15 0.26 MB/sec warmup 11 sec latency 2037.481 ms 2024-03-19T06:22:13.206 INFO:tasks.workunit.client.0.smithi017.stdout: 5 19 0.42 MB/sec warmup 12 sec latency 2043.966 ms 2024-03-19T06:22:14.205 INFO:tasks.workunit.client.0.smithi017.stdout: 7 23 0.46 MB/sec warmup 13 sec latency 2469.423 ms 2024-03-19T06:22:15.205 INFO:tasks.workunit.client.0.smithi017.stdout: 9 30 0.68 MB/sec warmup 14 sec latency 2399.457 ms 2024-03-19T06:22:16.205 INFO:tasks.workunit.client.0.smithi017.stdout: 10 35 0.83 MB/sec warmup 15 sec latency 2127.404 ms 2024-03-19T06:22:17.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 39 0.94 MB/sec warmup 16 sec latency 2173.414 ms 2024-03-19T06:22:18.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 43 0.97 MB/sec warmup 17 sec latency 2411.272 ms 2024-03-19T06:22:19.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 48 1.08 MB/sec warmup 18 sec latency 2393.281 ms 2024-03-19T06:22:20.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 53 1.13 MB/sec warmup 19 sec latency 2739.439 ms 2024-03-19T06:22:21.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 57 1.22 MB/sec warmup 20 sec latency 2254.142 ms 2024-03-19T06:22:22.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 62 1.27 MB/sec warmup 21 sec latency 2423.641 ms 2024-03-19T06:22:22.231 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:22.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:23.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 67 1.34 MB/sec warmup 22 sec latency 2242.713 ms 2024-03-19T06:22:24.206 INFO:tasks.workunit.client.0.smithi017.stdout: 10 72 1.38 MB/sec warmup 23 sec latency 2212.539 ms 2024-03-19T06:22:25.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 77 1.43 MB/sec warmup 24 sec latency 2073.556 ms 2024-03-19T06:22:26.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 81 1.47 MB/sec warmup 25 sec latency 2478.266 ms 2024-03-19T06:22:27.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 86 1.49 MB/sec warmup 26 sec latency 2501.239 ms 2024-03-19T06:22:28.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 90 1.54 MB/sec warmup 27 sec latency 2229.680 ms 2024-03-19T06:22:29.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 95 1.57 MB/sec warmup 28 sec latency 2258.490 ms 2024-03-19T06:22:30.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 99 1.60 MB/sec warmup 29 sec latency 2289.414 ms 2024-03-19T06:22:31.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 103 1.60 MB/sec warmup 30 sec latency 2750.215 ms 2024-03-19T06:22:32.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 106 1.60 MB/sec warmup 31 sec latency 2960.438 ms 2024-03-19T06:22:33.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 110 1.61 MB/sec warmup 32 sec latency 2791.876 ms 2024-03-19T06:22:34.207 INFO:tasks.workunit.client.0.smithi017.stdout: 10 113 1.60 MB/sec warmup 33 sec latency 2446.800 ms 2024-03-19T06:22:35.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 115 1.56 MB/sec warmup 34 sec latency 2194.754 ms 2024-03-19T06:22:36.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 117 1.53 MB/sec warmup 35 sec latency 2583.625 ms 2024-03-19T06:22:37.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 119 1.52 MB/sec warmup 36 sec latency 3210.567 ms 2024-03-19T06:22:38.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 123 1.50 MB/sec warmup 37 sec latency 3345.664 ms 2024-03-19T06:22:39.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 125 1.49 MB/sec warmup 38 sec latency 2315.164 ms 2024-03-19T06:22:40.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 128 1.48 MB/sec warmup 39 sec latency 2483.659 ms 2024-03-19T06:22:41.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 129 1.45 MB/sec warmup 40 sec latency 2915.337 ms 2024-03-19T06:22:42.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 133 1.44 MB/sec warmup 41 sec latency 3245.931 ms 2024-03-19T06:22:43.208 INFO:tasks.workunit.client.0.smithi017.stdout: 10 133 1.40 MB/sec warmup 42 sec latency 3699.190 ms 2024-03-19T06:22:44.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 136 1.39 MB/sec warmup 43 sec latency 3878.403 ms 2024-03-19T06:22:45.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 139 1.38 MB/sec warmup 44 sec latency 2932.470 ms 2024-03-19T06:22:46.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 139 1.35 MB/sec warmup 45 sec latency 2358.220 ms 2024-03-19T06:22:47.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 140 1.32 MB/sec warmup 46 sec latency 2768.362 ms 2024-03-19T06:22:48.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 143 1.31 MB/sec warmup 47 sec latency 3759.842 ms 2024-03-19T06:22:49.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 144 1.29 MB/sec warmup 48 sec latency 4342.825 ms 2024-03-19T06:22:50.209 INFO:tasks.workunit.client.0.smithi017.stdout: 10 147 1.28 MB/sec warmup 49 sec latency 4054.672 ms 2024-03-19T06:22:51.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 147 1.26 MB/sec warmup 50 sec latency 3968.887 ms 2024-03-19T06:22:52.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 147 1.24 MB/sec warmup 51 sec latency 4317.283 ms 2024-03-19T06:22:52.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:52.386 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:22:53.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 149 1.22 MB/sec warmup 52 sec latency 5237.640 ms 2024-03-19T06:22:54.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 152 1.21 MB/sec warmup 53 sec latency 5452.332 ms 2024-03-19T06:22:55.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 154 1.21 MB/sec warmup 54 sec latency 4701.605 ms 2024-03-19T06:22:56.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 156 1.19 MB/sec warmup 55 sec latency 2724.020 ms 2024-03-19T06:22:57.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 157 1.18 MB/sec warmup 56 sec latency 2843.765 ms 2024-03-19T06:22:58.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 160 1.16 MB/sec warmup 57 sec latency 2917.516 ms 2024-03-19T06:22:59.210 INFO:tasks.workunit.client.0.smithi017.stdout: 10 162 1.16 MB/sec warmup 58 sec latency 3375.984 ms 2024-03-19T06:23:00.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 165 1.16 MB/sec warmup 59 sec latency 2215.106 ms 2024-03-19T06:23:01.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 168 1.15 MB/sec warmup 60 sec latency 2775.136 ms 2024-03-19T06:23:02.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 170 1.15 MB/sec warmup 61 sec latency 3163.755 ms 2024-03-19T06:23:03.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 170 1.13 MB/sec warmup 62 sec latency 3601.797 ms 2024-03-19T06:23:04.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 173 1.13 MB/sec warmup 63 sec latency 4165.449 ms 2024-03-19T06:23:05.005 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:34.006 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.010 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:34.011 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.099 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:17:34.100 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.132 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:17:34.150 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.135 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:34.153 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.144 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:17:34.162 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.149 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:34.167 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.202 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:17:34.219 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:05.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 174 1.11 MB/sec warmup 64 sec latency 4202.314 ms 2024-03-19T06:23:05.244 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:17:34.262 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:23:06.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 178 1.11 MB/sec warmup 65 sec latency 3539.440 ms 2024-03-19T06:23:07.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 178 1.10 MB/sec warmup 66 sec latency 3230.240 ms 2024-03-19T06:23:08.211 INFO:tasks.workunit.client.0.smithi017.stdout: 10 180 1.09 MB/sec warmup 67 sec latency 4072.636 ms 2024-03-19T06:23:09.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 182 1.08 MB/sec warmup 68 sec latency 4824.620 ms 2024-03-19T06:23:10.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 182 1.07 MB/sec warmup 69 sec latency 4706.646 ms 2024-03-19T06:23:11.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 185 1.06 MB/sec warmup 70 sec latency 5538.442 ms 2024-03-19T06:23:12.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 186 1.06 MB/sec warmup 71 sec latency 5620.033 ms 2024-03-19T06:23:13.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 187 1.05 MB/sec warmup 72 sec latency 5291.061 ms 2024-03-19T06:23:14.212 INFO:tasks.workunit.client.0.smithi017.stdout: 10 190 1.04 MB/sec warmup 73 sec latency 5371.745 ms 2024-03-19T06:23:15.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 193 1.04 MB/sec warmup 74 sec latency 4386.626 ms 2024-03-19T06:23:16.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 194 1.04 MB/sec warmup 75 sec latency 4624.130 ms 2024-03-19T06:23:17.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 196 1.03 MB/sec warmup 76 sec latency 3459.446 ms 2024-03-19T06:23:18.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 198 1.02 MB/sec warmup 77 sec latency 2867.536 ms 2024-03-19T06:23:19.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 201 1.02 MB/sec warmup 78 sec latency 2912.534 ms 2024-03-19T06:23:20.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 203 1.01 MB/sec warmup 79 sec latency 2731.863 ms 2024-03-19T06:23:21.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 205 1.01 MB/sec warmup 80 sec latency 2573.412 ms 2024-03-19T06:23:22.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 207 1.00 MB/sec warmup 81 sec latency 3117.193 ms 2024-03-19T06:23:22.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:22.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:23.213 INFO:tasks.workunit.client.0.smithi017.stdout: 10 211 1.00 MB/sec warmup 82 sec latency 3264.649 ms 2024-03-19T06:23:24.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 213 1.00 MB/sec warmup 83 sec latency 2966.329 ms 2024-03-19T06:23:25.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 215 1.00 MB/sec warmup 84 sec latency 2529.237 ms 2024-03-19T06:23:26.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 219 1.00 MB/sec warmup 85 sec latency 2743.409 ms 2024-03-19T06:23:27.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 220 0.99 MB/sec warmup 86 sec latency 2918.522 ms 2024-03-19T06:23:28.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 222 0.99 MB/sec warmup 87 sec latency 3709.097 ms 2024-03-19T06:23:29.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 224 0.99 MB/sec warmup 88 sec latency 4477.290 ms 2024-03-19T06:23:30.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 226 0.98 MB/sec warmup 89 sec latency 3955.078 ms 2024-03-19T06:23:31.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 228 0.98 MB/sec warmup 90 sec latency 3665.913 ms 2024-03-19T06:23:32.214 INFO:tasks.workunit.client.0.smithi017.stdout: 10 231 0.97 MB/sec warmup 91 sec latency 4155.180 ms 2024-03-19T06:23:33.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 232 0.97 MB/sec warmup 92 sec latency 3731.783 ms 2024-03-19T06:23:34.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 235 0.97 MB/sec warmup 93 sec latency 4568.190 ms 2024-03-19T06:23:35.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 236 0.96 MB/sec warmup 94 sec latency 4121.480 ms 2024-03-19T06:23:36.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 236 0.95 MB/sec warmup 95 sec latency 4408.427 ms 2024-03-19T06:23:37.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 239 0.96 MB/sec warmup 96 sec latency 4758.910 ms 2024-03-19T06:23:38.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 242 0.95 MB/sec warmup 97 sec latency 5202.659 ms 2024-03-19T06:23:39.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 243 0.95 MB/sec warmup 98 sec latency 5101.488 ms 2024-03-19T06:23:40.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 243 0.94 MB/sec warmup 99 sec latency 6101.596 ms 2024-03-19T06:23:41.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 244 0.93 MB/sec warmup 100 sec latency 6591.262 ms 2024-03-19T06:23:42.215 INFO:tasks.workunit.client.0.smithi017.stdout: 10 246 0.93 MB/sec warmup 101 sec latency 5104.237 ms 2024-03-19T06:23:43.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 251 0.93 MB/sec warmup 102 sec latency 5409.563 ms 2024-03-19T06:23:44.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 251 0.93 MB/sec warmup 103 sec latency 3383.838 ms 2024-03-19T06:23:45.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 254 0.93 MB/sec warmup 104 sec latency 3449.870 ms 2024-03-19T06:23:46.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 254 0.92 MB/sec warmup 105 sec latency 3873.050 ms 2024-03-19T06:23:47.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 255 0.91 MB/sec warmup 106 sec latency 4401.248 ms 2024-03-19T06:23:48.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 256 0.91 MB/sec warmup 107 sec latency 5122.895 ms 2024-03-19T06:23:49.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 259 0.91 MB/sec warmup 108 sec latency 5573.621 ms 2024-03-19T06:23:50.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 262 0.91 MB/sec warmup 109 sec latency 5681.241 ms 2024-03-19T06:23:51.216 INFO:tasks.workunit.client.0.smithi017.stdout: 10 262 0.90 MB/sec warmup 110 sec latency 4917.817 ms 2024-03-19T06:23:52.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 263 0.89 MB/sec warmup 111 sec latency 5629.448 ms 2024-03-19T06:23:52.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:52.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:23:53.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 268 0.90 MB/sec warmup 112 sec latency 3859.160 ms 2024-03-19T06:23:54.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 270 0.90 MB/sec warmup 113 sec latency 4044.370 ms 2024-03-19T06:23:55.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 270 0.89 MB/sec warmup 114 sec latency 2859.550 ms 2024-03-19T06:23:56.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 273 0.89 MB/sec warmup 115 sec latency 3421.018 ms 2024-03-19T06:23:57.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 276 0.89 MB/sec warmup 116 sec latency 3518.859 ms 2024-03-19T06:23:58.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 278 0.89 MB/sec warmup 117 sec latency 3635.840 ms 2024-03-19T06:23:59.217 INFO:tasks.workunit.client.0.smithi017.stdout: 10 278 0.88 MB/sec warmup 118 sec latency 3221.455 ms 2024-03-19T06:24:00.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 280 0.88 MB/sec warmup 119 sec latency 4131.735 ms 2024-03-19T06:24:02.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 286 1.04 MB/sec execute 1 sec latency 4244.814 ms 2024-03-19T06:24:03.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 286 0.65 MB/sec execute 2 sec latency 2648.804 ms 2024-03-19T06:24:04.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 288 0.54 MB/sec execute 3 sec latency 3366.974 ms 2024-03-19T06:24:05.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 290 0.59 MB/sec execute 4 sec latency 3766.454 ms 2024-03-19T06:24:06.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 293 0.62 MB/sec execute 5 sec latency 2824.540 ms 2024-03-19T06:24:07.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 296 0.65 MB/sec execute 6 sec latency 2304.320 ms 2024-03-19T06:24:08.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 296 0.59 MB/sec execute 7 sec latency 2729.431 ms 2024-03-19T06:24:09.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 298 0.59 MB/sec execute 8 sec latency 3504.785 ms 2024-03-19T06:24:10.218 INFO:tasks.workunit.client.0.smithi017.stdout: 10 300 0.58 MB/sec execute 9 sec latency 3921.945 ms 2024-03-19T06:24:11.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 303 0.62 MB/sec execute 10 sec latency 3803.771 ms 2024-03-19T06:24:12.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 305 0.61 MB/sec execute 11 sec latency 3072.101 ms 2024-03-19T06:24:13.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 307 0.63 MB/sec execute 12 sec latency 3088.574 ms 2024-03-19T06:24:14.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 307 0.58 MB/sec execute 13 sec latency 3466.816 ms 2024-03-19T06:24:15.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 312 0.64 MB/sec execute 14 sec latency 3659.196 ms 2024-03-19T06:24:16.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 314 0.62 MB/sec execute 15 sec latency 3105.306 ms 2024-03-19T06:24:17.219 INFO:tasks.workunit.client.0.smithi017.stdout: 10 316 0.63 MB/sec execute 16 sec latency 2347.051 ms 2024-03-19T06:24:18.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 316 0.60 MB/sec execute 17 sec latency 3180.441 ms 2024-03-19T06:24:19.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 317 0.58 MB/sec execute 18 sec latency 3995.734 ms 2024-03-19T06:24:20.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 318 0.56 MB/sec execute 19 sec latency 4664.047 ms 2024-03-19T06:24:21.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 321 0.58 MB/sec execute 20 sec latency 4698.493 ms 2024-03-19T06:24:22.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 322 0.56 MB/sec execute 21 sec latency 3078.061 ms 2024-03-19T06:24:22.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:22.805 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:23.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 322 0.54 MB/sec execute 22 sec latency 4078.185 ms 2024-03-19T06:24:24.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 327 0.59 MB/sec execute 23 sec latency 4199.843 ms 2024-03-19T06:24:25.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 328 0.56 MB/sec execute 24 sec latency 4014.158 ms 2024-03-19T06:24:26.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 329 0.55 MB/sec execute 25 sec latency 2738.402 ms 2024-03-19T06:24:27.220 INFO:tasks.workunit.client.0.smithi017.stdout: 10 333 0.58 MB/sec execute 26 sec latency 2993.147 ms 2024-03-19T06:24:28.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 335 0.59 MB/sec execute 27 sec latency 3343.248 ms 2024-03-19T06:24:29.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 336 0.58 MB/sec execute 28 sec latency 2942.951 ms 2024-03-19T06:24:30.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 338 0.57 MB/sec execute 29 sec latency 3670.128 ms 2024-03-19T06:24:31.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 343 0.62 MB/sec execute 30 sec latency 2681.625 ms 2024-03-19T06:24:32.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 344 0.60 MB/sec execute 31 sec latency 2430.897 ms 2024-03-19T06:24:33.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 344 0.59 MB/sec execute 32 sec latency 3104.283 ms 2024-03-19T06:24:34.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 346 0.58 MB/sec execute 33 sec latency 3427.494 ms 2024-03-19T06:24:35.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 350 0.60 MB/sec execute 34 sec latency 3728.671 ms 2024-03-19T06:24:36.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 352 0.60 MB/sec execute 35 sec latency 2414.549 ms 2024-03-19T06:24:37.221 INFO:tasks.workunit.client.0.smithi017.stdout: 10 354 0.60 MB/sec execute 36 sec latency 2532.976 ms 2024-03-19T06:24:38.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 354 0.58 MB/sec execute 37 sec latency 3533.076 ms 2024-03-19T06:24:39.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 355 0.57 MB/sec execute 38 sec latency 4141.837 ms 2024-03-19T06:24:40.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 356 0.57 MB/sec execute 39 sec latency 5022.494 ms 2024-03-19T06:24:41.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 360 0.58 MB/sec execute 40 sec latency 5091.296 ms 2024-03-19T06:24:42.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 363 0.60 MB/sec execute 41 sec latency 4626.284 ms 2024-03-19T06:24:43.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 364 0.59 MB/sec execute 42 sec latency 3416.457 ms 2024-03-19T06:24:44.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 366 0.59 MB/sec execute 43 sec latency 3296.983 ms 2024-03-19T06:24:45.222 INFO:tasks.workunit.client.0.smithi017.stdout: 10 370 0.60 MB/sec execute 44 sec latency 3375.875 ms 2024-03-19T06:24:46.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 373 0.61 MB/sec execute 45 sec latency 2559.962 ms 2024-03-19T06:24:47.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 375 0.61 MB/sec execute 46 sec latency 2572.983 ms 2024-03-19T06:24:48.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 376 0.61 MB/sec execute 47 sec latency 2943.960 ms 2024-03-19T06:24:49.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 377 0.60 MB/sec execute 48 sec latency 3858.286 ms 2024-03-19T06:24:50.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 379 0.61 MB/sec execute 49 sec latency 4505.150 ms 2024-03-19T06:24:51.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 384 0.62 MB/sec execute 50 sec latency 4071.051 ms 2024-03-19T06:24:52.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 386 0.63 MB/sec execute 51 sec latency 2536.067 ms 2024-03-19T06:24:52.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:52.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:24:53.223 INFO:tasks.workunit.client.0.smithi017.stdout: 10 387 0.62 MB/sec execute 52 sec latency 2744.800 ms 2024-03-19T06:24:54.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 388 0.61 MB/sec execute 53 sec latency 3424.179 ms 2024-03-19T06:24:55.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 392 0.62 MB/sec execute 54 sec latency 3778.975 ms 2024-03-19T06:24:56.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 394 0.63 MB/sec execute 55 sec latency 3596.038 ms 2024-03-19T06:24:57.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 396 0.63 MB/sec execute 56 sec latency 3658.727 ms 2024-03-19T06:24:58.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 396 0.62 MB/sec execute 57 sec latency 3458.802 ms 2024-03-19T06:24:59.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 401 0.64 MB/sec execute 58 sec latency 3672.806 ms 2024-03-19T06:25:00.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 402 0.63 MB/sec execute 59 sec latency 4430.684 ms 2024-03-19T06:25:01.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 402 0.62 MB/sec execute 60 sec latency 4620.070 ms 2024-03-19T06:25:02.224 INFO:tasks.workunit.client.0.smithi017.stdout: 10 404 0.62 MB/sec execute 61 sec latency 5166.839 ms 2024-03-19T06:25:03.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 405 0.62 MB/sec execute 62 sec latency 4780.191 ms 2024-03-19T06:25:04.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 406 0.61 MB/sec execute 63 sec latency 5377.386 ms 2024-03-19T06:25:04.706 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:33.707 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.720 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:33.721 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.821 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:33.839 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.825 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:33.844 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.841 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:19:33.843 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.849 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:19:33.867 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.852 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:19:33.871 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.934 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:19:33.952 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:04.962 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:19:33.980 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:25:05.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 409 0.61 MB/sec execute 64 sec latency 6377.467 ms 2024-03-19T06:25:06.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 411 0.62 MB/sec execute 65 sec latency 6404.337 ms 2024-03-19T06:25:07.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 411 0.61 MB/sec execute 66 sec latency 5108.080 ms 2024-03-19T06:25:08.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 417 0.62 MB/sec execute 67 sec latency 5242.843 ms 2024-03-19T06:25:09.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 417 0.62 MB/sec execute 68 sec latency 3789.860 ms 2024-03-19T06:25:10.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 419 0.62 MB/sec execute 69 sec latency 4287.373 ms 2024-03-19T06:25:11.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 421 0.61 MB/sec execute 70 sec latency 3369.590 ms 2024-03-19T06:25:12.225 INFO:tasks.workunit.client.0.smithi017.stdout: 10 424 0.63 MB/sec execute 71 sec latency 3803.714 ms 2024-03-19T06:25:13.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 425 0.62 MB/sec execute 72 sec latency 3402.510 ms 2024-03-19T06:25:14.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 428 0.62 MB/sec execute 73 sec latency 3484.526 ms 2024-03-19T06:25:15.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 429 0.62 MB/sec execute 74 sec latency 3648.522 ms 2024-03-19T06:25:16.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 431 0.62 MB/sec execute 75 sec latency 4119.388 ms 2024-03-19T06:25:17.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 433 0.62 MB/sec execute 76 sec latency 4608.935 ms 2024-03-19T06:25:18.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 435 0.62 MB/sec execute 77 sec latency 4684.375 ms 2024-03-19T06:25:19.226 INFO:tasks.workunit.client.0.smithi017.stdout: 10 438 0.63 MB/sec execute 78 sec latency 5131.323 ms 2024-03-19T06:25:20.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 439 0.62 MB/sec execute 79 sec latency 3170.963 ms 2024-03-19T06:25:21.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 439 0.61 MB/sec execute 80 sec latency 4171.087 ms 2024-03-19T06:25:22.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 440 0.61 MB/sec execute 81 sec latency 4879.525 ms 2024-03-19T06:25:23.096 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:25:23.104 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:25:23.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 444 0.62 MB/sec execute 82 sec latency 5720.976 ms 2024-03-19T06:25:24.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 446 0.62 MB/sec execute 83 sec latency 5310.473 ms 2024-03-19T06:25:25.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 448 0.62 MB/sec execute 84 sec latency 5480.450 ms 2024-03-19T06:25:26.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 449 0.61 MB/sec execute 85 sec latency 3371.390 ms 2024-03-19T06:25:27.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 450 0.61 MB/sec execute 86 sec latency 3900.130 ms 2024-03-19T06:25:28.227 INFO:tasks.workunit.client.0.smithi017.stdout: 10 455 0.62 MB/sec execute 87 sec latency 4334.884 ms 2024-03-19T06:25:29.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 457 0.62 MB/sec execute 88 sec latency 2611.140 ms 2024-03-19T06:25:30.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 457 0.62 MB/sec execute 89 sec latency 2940.366 ms 2024-03-19T06:25:31.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 457 0.61 MB/sec execute 90 sec latency 3865.712 ms 2024-03-19T06:25:32.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 459 0.61 MB/sec execute 91 sec latency 4118.790 ms 2024-03-19T06:25:33.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 462 0.61 MB/sec execute 92 sec latency 4883.127 ms 2024-03-19T06:25:34.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 465 0.62 MB/sec execute 93 sec latency 2307.482 ms 2024-03-19T06:25:35.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 466 0.62 MB/sec execute 94 sec latency 3146.554 ms 2024-03-19T06:25:36.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 468 0.62 MB/sec execute 95 sec latency 3552.536 ms 2024-03-19T06:25:37.228 INFO:tasks.workunit.client.0.smithi017.stdout: 10 472 0.62 MB/sec execute 96 sec latency 3351.602 ms 2024-03-19T06:25:38.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 473 0.62 MB/sec execute 97 sec latency 2928.213 ms 2024-03-19T06:25:39.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 474 0.62 MB/sec execute 98 sec latency 3928.318 ms 2024-03-19T06:25:40.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 476 0.62 MB/sec execute 99 sec latency 3999.524 ms 2024-03-19T06:25:41.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 477 0.61 MB/sec execute 100 sec latency 4633.984 ms 2024-03-19T06:25:42.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 478 0.61 MB/sec execute 101 sec latency 4957.585 ms 2024-03-19T06:25:43.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 482 0.62 MB/sec execute 102 sec latency 5248.258 ms 2024-03-19T06:25:44.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 485 0.62 MB/sec execute 103 sec latency 2729.886 ms 2024-03-19T06:25:45.229 INFO:tasks.workunit.client.0.smithi017.stdout: 10 485 0.62 MB/sec execute 104 sec latency 3730.039 ms 2024-03-19T06:25:46.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 486 0.61 MB/sec execute 105 sec latency 3875.653 ms 2024-03-19T06:25:47.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 488 0.61 MB/sec execute 106 sec latency 4214.150 ms 2024-03-19T06:25:48.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 493 0.62 MB/sec execute 107 sec latency 4268.228 ms 2024-03-19T06:25:49.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 494 0.62 MB/sec execute 108 sec latency 3725.929 ms 2024-03-19T06:25:50.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 495 0.62 MB/sec execute 109 sec latency 3885.872 ms 2024-03-19T06:25:51.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 495 0.62 MB/sec execute 110 sec latency 4008.784 ms 2024-03-19T06:25:52.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 495 0.61 MB/sec execute 111 sec latency 5008.899 ms 2024-03-19T06:25:53.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:25:53.227 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:25:53.230 INFO:tasks.workunit.client.0.smithi017.stdout: 10 500 0.61 MB/sec execute 112 sec latency 5383.318 ms 2024-03-19T06:25:54.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 505 0.62 MB/sec execute 113 sec latency 5324.902 ms 2024-03-19T06:25:55.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 508 0.63 MB/sec execute 114 sec latency 2376.067 ms 2024-03-19T06:25:56.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 509 0.63 MB/sec execute 115 sec latency 3194.879 ms 2024-03-19T06:25:57.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 513 0.63 MB/sec execute 116 sec latency 3261.345 ms 2024-03-19T06:25:58.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 513 0.62 MB/sec execute 117 sec latency 2581.863 ms 2024-03-19T06:25:59.231 INFO:tasks.workunit.client.0.smithi017.stdout: 10 517 0.63 MB/sec execute 118 sec latency 3581.949 ms 2024-03-19T06:26:00.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 517 0.63 MB/sec execute 119 sec latency 4582.737 ms 2024-03-19T06:26:01.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 519 0.63 MB/sec execute 120 sec latency 5582.873 ms 2024-03-19T06:26:02.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 520 0.62 MB/sec execute 121 sec latency 6583.007 ms 2024-03-19T06:26:03.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 525 0.62 MB/sec execute 122 sec latency 7583.111 ms 2024-03-19T06:26:04.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 529 0.63 MB/sec execute 123 sec latency 7666.302 ms 2024-03-19T06:26:05.232 INFO:tasks.workunit.client.0.smithi017.stdout: 10 531 0.63 MB/sec execute 124 sec latency 3329.962 ms 2024-03-19T06:26:06.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 534 0.63 MB/sec execute 125 sec latency 3016.231 ms 2024-03-19T06:26:07.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 536 0.64 MB/sec execute 126 sec latency 2964.709 ms 2024-03-19T06:26:08.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 541 0.65 MB/sec execute 127 sec latency 3964.818 ms 2024-03-19T06:26:09.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 543 0.65 MB/sec execute 128 sec latency 4964.969 ms 2024-03-19T06:26:10.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 545 0.66 MB/sec execute 129 sec latency 5965.082 ms 2024-03-19T06:26:11.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 552 0.67 MB/sec execute 130 sec latency 6684.173 ms 2024-03-19T06:26:12.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 555 0.67 MB/sec execute 131 sec latency 5066.321 ms 2024-03-19T06:26:13.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 562 0.68 MB/sec execute 132 sec latency 6066.469 ms 2024-03-19T06:26:14.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 568 0.68 MB/sec execute 133 sec latency 7066.568 ms 2024-03-19T06:26:15.233 INFO:tasks.workunit.client.0.smithi017.stdout: 10 575 0.71 MB/sec execute 134 sec latency 8066.668 ms 2024-03-19T06:26:16.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 578 0.71 MB/sec execute 135 sec latency 8925.241 ms 2024-03-19T06:26:17.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 584 0.70 MB/sec execute 136 sec latency 5797.294 ms 2024-03-19T06:26:18.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 589 0.71 MB/sec execute 137 sec latency 4175.866 ms 2024-03-19T06:26:19.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 596 0.73 MB/sec execute 138 sec latency 5175.971 ms 2024-03-19T06:26:20.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 599 0.74 MB/sec execute 139 sec latency 6176.089 ms 2024-03-19T06:26:21.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 601 0.73 MB/sec execute 140 sec latency 7169.046 ms 2024-03-19T06:26:22.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 604 0.73 MB/sec execute 141 sec latency 5454.301 ms 2024-03-19T06:26:23.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 609 0.73 MB/sec execute 142 sec latency 3662.373 ms 2024-03-19T06:26:23.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:26:23.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:26:24.234 INFO:tasks.workunit.client.0.smithi017.stdout: 10 611 0.73 MB/sec execute 143 sec latency 4345.063 ms 2024-03-19T06:26:25.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 611 0.72 MB/sec execute 144 sec latency 5345.182 ms 2024-03-19T06:26:26.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 612 0.72 MB/sec execute 145 sec latency 6345.308 ms 2024-03-19T06:26:27.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 612 0.71 MB/sec execute 146 sec latency 6377.570 ms 2024-03-19T06:26:28.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 615 0.71 MB/sec execute 147 sec latency 6041.944 ms 2024-03-19T06:26:29.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 616 0.71 MB/sec execute 148 sec latency 6228.482 ms 2024-03-19T06:26:30.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 618 0.70 MB/sec execute 149 sec latency 5543.035 ms 2024-03-19T06:26:31.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 618 0.70 MB/sec execute 150 sec latency 5591.355 ms 2024-03-19T06:26:32.235 INFO:tasks.workunit.client.0.smithi017.stdout: 10 621 0.69 MB/sec execute 151 sec latency 5756.643 ms 2024-03-19T06:26:33.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 622 0.69 MB/sec execute 152 sec latency 4251.253 ms 2024-03-19T06:26:34.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 624 0.68 MB/sec execute 153 sec latency 5036.698 ms 2024-03-19T06:26:35.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 628 0.68 MB/sec execute 154 sec latency 5395.400 ms 2024-03-19T06:26:36.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 631 0.68 MB/sec execute 155 sec latency 4220.528 ms 2024-03-19T06:26:37.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 635 0.67 MB/sec execute 156 sec latency 4791.297 ms 2024-03-19T06:26:38.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 640 0.67 MB/sec execute 157 sec latency 5029.945 ms 2024-03-19T06:26:39.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 642 0.67 MB/sec execute 158 sec latency 4532.034 ms 2024-03-19T06:26:40.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 642 0.66 MB/sec execute 159 sec latency 5532.178 ms 2024-03-19T06:26:41.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 642 0.66 MB/sec execute 160 sec latency 5807.125 ms 2024-03-19T06:26:42.236 INFO:tasks.workunit.client.0.smithi017.stdout: 10 642 0.65 MB/sec execute 161 sec latency 6389.885 ms 2024-03-19T06:26:43.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 645 0.65 MB/sec execute 162 sec latency 6741.209 ms 2024-03-19T06:26:44.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 646 0.65 MB/sec execute 163 sec latency 6730.909 ms 2024-03-19T06:26:45.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 646 0.64 MB/sec execute 164 sec latency 7197.607 ms 2024-03-19T06:26:46.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 646 0.64 MB/sec execute 165 sec latency 7208.870 ms 2024-03-19T06:26:47.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 647 0.63 MB/sec execute 166 sec latency 4597.512 ms 2024-03-19T06:26:48.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 648 0.63 MB/sec execute 167 sec latency 5501.139 ms 2024-03-19T06:26:49.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 649 0.63 MB/sec execute 168 sec latency 6212.167 ms 2024-03-19T06:26:50.237 INFO:tasks.workunit.client.0.smithi017.stdout: 10 650 0.62 MB/sec execute 169 sec latency 5749.931 ms 2024-03-19T06:26:51.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 651 0.62 MB/sec execute 170 sec latency 5457.847 ms 2024-03-19T06:26:52.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 653 0.62 MB/sec execute 171 sec latency 5887.234 ms 2024-03-19T06:26:53.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 654 0.61 MB/sec execute 172 sec latency 4877.442 ms 2024-03-19T06:26:53.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:26:53.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:26:54.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 655 0.61 MB/sec execute 173 sec latency 5877.564 ms 2024-03-19T06:26:55.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 656 0.61 MB/sec execute 174 sec latency 6877.707 ms 2024-03-19T06:26:56.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 656 0.60 MB/sec execute 175 sec latency 7590.520 ms 2024-03-19T06:26:57.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 657 0.60 MB/sec execute 176 sec latency 6964.354 ms 2024-03-19T06:26:58.238 INFO:tasks.workunit.client.0.smithi017.stdout: 10 658 0.60 MB/sec execute 177 sec latency 7049.682 ms 2024-03-19T06:26:59.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 659 0.59 MB/sec execute 178 sec latency 7213.931 ms 2024-03-19T06:27:00.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 659 0.59 MB/sec execute 179 sec latency 7493.657 ms 2024-03-19T06:27:01.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 661 0.59 MB/sec execute 180 sec latency 7280.332 ms 2024-03-19T06:27:02.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 662 0.58 MB/sec execute 181 sec latency 7498.370 ms 2024-03-19T06:27:03.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 663 0.58 MB/sec execute 182 sec latency 7074.714 ms 2024-03-19T06:27:04.239 INFO:tasks.workunit.client.0.smithi017.stdout: 10 664 0.58 MB/sec execute 183 sec latency 5905.875 ms 2024-03-19T06:27:05.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 667 0.58 MB/sec execute 184 sec latency 6258.480 ms 2024-03-19T06:27:06.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 669 0.57 MB/sec execute 185 sec latency 6763.562 ms 2024-03-19T06:27:07.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 672 0.57 MB/sec execute 186 sec latency 3160.745 ms 2024-03-19T06:27:08.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 675 0.57 MB/sec execute 187 sec latency 4160.877 ms 2024-03-19T06:27:09.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 677 0.57 MB/sec execute 188 sec latency 5161.021 ms 2024-03-19T06:27:10.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 679 0.56 MB/sec execute 189 sec latency 6161.158 ms 2024-03-19T06:27:11.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 681 0.56 MB/sec execute 190 sec latency 7161.262 ms 2024-03-19T06:27:12.240 INFO:tasks.workunit.client.0.smithi017.stdout: 10 682 0.56 MB/sec execute 191 sec latency 7555.973 ms 2024-03-19T06:27:13.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 684 0.55 MB/sec execute 192 sec latency 7768.444 ms 2024-03-19T06:27:14.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 685 0.55 MB/sec execute 193 sec latency 5726.574 ms 2024-03-19T06:27:15.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 685 0.55 MB/sec execute 194 sec latency 6726.693 ms 2024-03-19T06:27:16.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 687 0.55 MB/sec execute 195 sec latency 7282.127 ms 2024-03-19T06:27:17.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 688 0.54 MB/sec execute 196 sec latency 6420.042 ms 2024-03-19T06:27:18.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 689 0.54 MB/sec execute 197 sec latency 6622.506 ms 2024-03-19T06:27:19.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 690 0.54 MB/sec execute 198 sec latency 6703.227 ms 2024-03-19T06:27:20.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 691 0.54 MB/sec execute 199 sec latency 6475.296 ms 2024-03-19T06:27:21.241 INFO:tasks.workunit.client.0.smithi017.stdout: 10 693 0.53 MB/sec execute 200 sec latency 6276.898 ms 2024-03-19T06:27:22.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 695 0.53 MB/sec execute 201 sec latency 5709.788 ms 2024-03-19T06:27:23.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 697 0.53 MB/sec execute 202 sec latency 5481.789 ms 2024-03-19T06:27:23.650 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:27:23.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:27:24.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 700 0.53 MB/sec execute 203 sec latency 6251.409 ms 2024-03-19T06:27:25.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 702 0.52 MB/sec execute 204 sec latency 6270.786 ms 2024-03-19T06:27:26.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 705 0.52 MB/sec execute 205 sec latency 5348.336 ms 2024-03-19T06:27:27.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 707 0.52 MB/sec execute 206 sec latency 6348.491 ms 2024-03-19T06:27:28.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 709 0.52 MB/sec execute 207 sec latency 7309.133 ms 2024-03-19T06:27:29.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 711 0.51 MB/sec execute 208 sec latency 6293.141 ms 2024-03-19T06:27:30.242 INFO:tasks.workunit.client.0.smithi017.stdout: 10 713 0.51 MB/sec execute 209 sec latency 7293.251 ms 2024-03-19T06:27:31.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 715 0.51 MB/sec execute 210 sec latency 8293.341 ms 2024-03-19T06:27:32.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 717 0.51 MB/sec execute 211 sec latency 8294.688 ms 2024-03-19T06:27:33.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 717 0.50 MB/sec execute 212 sec latency 2950.280 ms 2024-03-19T06:27:34.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 717 0.50 MB/sec execute 213 sec latency 2894.463 ms 2024-03-19T06:27:35.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 718 0.50 MB/sec execute 214 sec latency 3894.591 ms 2024-03-19T06:27:36.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 718 0.50 MB/sec execute 215 sec latency 4894.728 ms 2024-03-19T06:27:37.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 720 0.50 MB/sec execute 216 sec latency 5894.829 ms 2024-03-19T06:27:38.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 722 0.49 MB/sec execute 217 sec latency 6894.927 ms 2024-03-19T06:27:39.243 INFO:tasks.workunit.client.0.smithi017.stdout: 10 725 0.49 MB/sec execute 218 sec latency 7895.037 ms 2024-03-19T06:27:40.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 728 0.49 MB/sec execute 219 sec latency 8895.142 ms 2024-03-19T06:27:41.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 728 0.49 MB/sec execute 220 sec latency 9895.289 ms 2024-03-19T06:27:42.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 731 0.49 MB/sec execute 221 sec latency 10854.654 ms 2024-03-19T06:27:43.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 733 0.48 MB/sec execute 222 sec latency 10872.142 ms 2024-03-19T06:27:44.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 737 0.48 MB/sec execute 223 sec latency 3024.243 ms 2024-03-19T06:27:45.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 740 0.48 MB/sec execute 224 sec latency 4024.375 ms 2024-03-19T06:27:46.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 742 0.48 MB/sec execute 225 sec latency 5024.468 ms 2024-03-19T06:27:47.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 743 0.48 MB/sec execute 226 sec latency 6024.582 ms 2024-03-19T06:27:48.244 INFO:tasks.workunit.client.0.smithi017.stdout: 10 744 0.47 MB/sec execute 227 sec latency 7024.719 ms 2024-03-19T06:27:49.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 746 0.47 MB/sec execute 228 sec latency 7532.724 ms 2024-03-19T06:27:50.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 748 0.47 MB/sec execute 229 sec latency 3062.992 ms 2024-03-19T06:27:51.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 750 0.47 MB/sec execute 230 sec latency 4063.096 ms 2024-03-19T06:27:52.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 750 0.47 MB/sec execute 231 sec latency 5063.237 ms 2024-03-19T06:27:53.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 750 0.46 MB/sec execute 232 sec latency 6063.371 ms 2024-03-19T06:27:53.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:27:53.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:27:54.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 751 0.46 MB/sec execute 233 sec latency 7063.477 ms 2024-03-19T06:27:55.245 INFO:tasks.workunit.client.0.smithi017.stdout: 10 751 0.46 MB/sec execute 234 sec latency 8014.026 ms 2024-03-19T06:27:56.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 752 0.46 MB/sec execute 235 sec latency 7752.821 ms 2024-03-19T06:27:57.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 753 0.46 MB/sec execute 236 sec latency 8371.210 ms 2024-03-19T06:27:58.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 753 0.46 MB/sec execute 237 sec latency 9305.499 ms 2024-03-19T06:27:59.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 756 0.45 MB/sec execute 238 sec latency 8788.000 ms 2024-03-19T06:28:00.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 758 0.45 MB/sec execute 239 sec latency 5344.019 ms 2024-03-19T06:28:01.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 759 0.45 MB/sec execute 240 sec latency 6158.300 ms 2024-03-19T06:28:02.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 762 0.45 MB/sec execute 241 sec latency 6861.984 ms 2024-03-19T06:28:03.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 764 0.45 MB/sec execute 242 sec latency 5016.262 ms 2024-03-19T06:28:04.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 767 0.45 MB/sec execute 243 sec latency 5710.341 ms 2024-03-19T06:28:05.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 770 0.44 MB/sec execute 244 sec latency 6225.986 ms 2024-03-19T06:28:06.246 INFO:tasks.workunit.client.0.smithi017.stdout: 10 774 0.44 MB/sec execute 245 sec latency 5166.342 ms 2024-03-19T06:28:07.247 INFO:tasks.workunit.client.0.smithi017.stdout: 10 777 0.44 MB/sec execute 246 sec latency 5855.161 ms 2024-03-19T06:28:08.247 INFO:tasks.workunit.client.0.smithi017.stdout: 10 779 0.44 MB/sec execute 247 sec latency 3399.457 ms 2024-03-19T06:28:09.247 INFO:tasks.workunit.client.0.smithi017.stdout: 10 781 0.44 MB/sec execute 248 sec latency 2311.583 ms 2024-03-19T06:28:10.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 781 0.44 MB/sec execute 249 sec latency 3311.739 ms 2024-03-19T06:28:11.247 INFO:tasks.workunit.client.0.smithi017.stdout: 10 782 0.43 MB/sec execute 250 sec latency 4311.833 ms 2024-03-19T06:28:12.247 INFO:tasks.workunit.client.0.smithi017.stdout: 10 785 0.43 MB/sec execute 251 sec latency 5311.934 ms 2024-03-19T06:28:13.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 786 0.43 MB/sec execute 252 sec latency 6312.056 ms 2024-03-19T06:28:14.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 786 0.43 MB/sec execute 253 sec latency 7312.173 ms 2024-03-19T06:28:15.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 786 0.43 MB/sec execute 254 sec latency 8312.282 ms 2024-03-19T06:28:16.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 787 0.43 MB/sec execute 255 sec latency 9312.424 ms 2024-03-19T06:28:17.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 788 0.42 MB/sec execute 256 sec latency 10312.575 ms 2024-03-19T06:28:18.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 789 0.42 MB/sec execute 257 sec latency 10881.060 ms 2024-03-19T06:28:19.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 792 0.42 MB/sec execute 258 sec latency 10711.400 ms 2024-03-19T06:28:20.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 793 0.42 MB/sec execute 259 sec latency 2142.634 ms 2024-03-19T06:28:21.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 797 0.42 MB/sec execute 260 sec latency 2693.058 ms 2024-03-19T06:28:22.248 INFO:tasks.workunit.client.0.smithi017.stdout: 10 798 0.42 MB/sec execute 261 sec latency 3693.187 ms 2024-03-19T06:28:23.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 800 0.42 MB/sec execute 262 sec latency 4693.304 ms 2024-03-19T06:28:23.937 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:28:23.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:28:24.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 802 0.42 MB/sec execute 263 sec latency 5693.490 ms 2024-03-19T06:28:25.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 804 0.41 MB/sec execute 264 sec latency 6693.596 ms 2024-03-19T06:28:26.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 806 0.41 MB/sec execute 265 sec latency 7693.730 ms 2024-03-19T06:28:27.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 808 0.41 MB/sec execute 266 sec latency 8693.837 ms 2024-03-19T06:28:28.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 810 0.41 MB/sec execute 267 sec latency 9693.943 ms 2024-03-19T06:28:29.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 811 0.41 MB/sec execute 268 sec latency 9994.831 ms 2024-03-19T06:28:30.249 INFO:tasks.workunit.client.0.smithi017.stdout: 10 813 0.41 MB/sec execute 269 sec latency 8437.675 ms 2024-03-19T06:28:31.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 813 0.40 MB/sec execute 270 sec latency 6747.571 ms 2024-03-19T06:28:32.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 813 0.40 MB/sec execute 271 sec latency 7747.659 ms 2024-03-19T06:28:33.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 813 0.40 MB/sec execute 272 sec latency 8273.028 ms 2024-03-19T06:28:34.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 814 0.40 MB/sec execute 273 sec latency 6455.401 ms 2024-03-19T06:28:35.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 814 0.40 MB/sec execute 274 sec latency 6571.173 ms 2024-03-19T06:28:36.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 814 0.40 MB/sec execute 275 sec latency 6720.583 ms 2024-03-19T06:28:37.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 817 0.40 MB/sec execute 276 sec latency 6879.341 ms 2024-03-19T06:28:38.250 INFO:tasks.workunit.client.0.smithi017.stdout: 10 818 0.40 MB/sec execute 277 sec latency 5064.843 ms 2024-03-19T06:28:39.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 818 0.39 MB/sec execute 278 sec latency 5292.260 ms 2024-03-19T06:28:40.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 819 0.39 MB/sec execute 279 sec latency 5884.406 ms 2024-03-19T06:28:41.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 819 0.39 MB/sec execute 280 sec latency 5983.739 ms 2024-03-19T06:28:42.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 820 0.39 MB/sec execute 281 sec latency 5333.080 ms 2024-03-19T06:28:43.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 821 0.39 MB/sec execute 282 sec latency 5843.075 ms 2024-03-19T06:28:44.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 824 0.39 MB/sec execute 283 sec latency 5654.459 ms 2024-03-19T06:28:45.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 825 0.39 MB/sec execute 284 sec latency 5690.951 ms 2024-03-19T06:28:46.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 826 0.38 MB/sec execute 285 sec latency 5657.723 ms 2024-03-19T06:28:47.251 INFO:tasks.workunit.client.0.smithi017.stdout: 10 826 0.38 MB/sec execute 286 sec latency 4992.502 ms 2024-03-19T06:28:48.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 827 0.38 MB/sec execute 287 sec latency 5647.770 ms 2024-03-19T06:28:49.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 828 0.38 MB/sec execute 288 sec latency 5069.757 ms 2024-03-19T06:28:50.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 828 0.38 MB/sec execute 289 sec latency 5510.654 ms 2024-03-19T06:28:51.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 832 0.38 MB/sec execute 290 sec latency 4966.429 ms 2024-03-19T06:28:52.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 835 0.38 MB/sec execute 291 sec latency 3763.012 ms 2024-03-19T06:28:53.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 836 0.38 MB/sec execute 292 sec latency 4763.162 ms 2024-03-19T06:28:54.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:28:54.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:28:54.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 839 0.37 MB/sec execute 293 sec latency 5315.875 ms 2024-03-19T06:28:55.252 INFO:tasks.workunit.client.0.smithi017.stdout: 10 846 0.37 MB/sec execute 294 sec latency 4683.990 ms 2024-03-19T06:28:56.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 850 0.37 MB/sec execute 295 sec latency 5163.020 ms 2024-03-19T06:28:57.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 853 0.37 MB/sec execute 296 sec latency 5800.454 ms 2024-03-19T06:28:58.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 854 0.37 MB/sec execute 297 sec latency 6263.270 ms 2024-03-19T06:28:59.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 855 0.37 MB/sec execute 298 sec latency 6639.529 ms 2024-03-19T06:29:00.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 855 0.37 MB/sec execute 299 sec latency 6455.270 ms 2024-03-19T06:29:01.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 855 0.37 MB/sec execute 300 sec latency 6426.962 ms 2024-03-19T06:29:02.253 INFO:tasks.workunit.client.0.smithi017.stdout: 10 856 0.37 MB/sec execute 301 sec latency 7427.087 ms 2024-03-19T06:29:03.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 857 0.37 MB/sec execute 302 sec latency 7499.389 ms 2024-03-19T06:29:04.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 857 0.36 MB/sec execute 303 sec latency 5376.076 ms 2024-03-19T06:29:05.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 858 0.36 MB/sec execute 304 sec latency 5528.229 ms 2024-03-19T06:29:06.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 858 0.36 MB/sec execute 305 sec latency 3928.171 ms 2024-03-19T06:29:07.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 859 0.36 MB/sec execute 306 sec latency 4928.308 ms 2024-03-19T06:29:08.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 860 0.36 MB/sec execute 307 sec latency 5928.488 ms 2024-03-19T06:29:09.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 862 0.36 MB/sec execute 308 sec latency 6096.126 ms 2024-03-19T06:29:10.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 863 0.36 MB/sec execute 309 sec latency 5946.950 ms 2024-03-19T06:29:11.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 864 0.36 MB/sec execute 310 sec latency 4845.228 ms 2024-03-19T06:29:12.254 INFO:tasks.workunit.client.0.smithi017.stdout: 10 865 0.36 MB/sec execute 311 sec latency 5845.321 ms 2024-03-19T06:29:13.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 866 0.35 MB/sec execute 312 sec latency 6058.982 ms 2024-03-19T06:29:14.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 867 0.35 MB/sec execute 313 sec latency 6401.714 ms 2024-03-19T06:29:15.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 867 0.35 MB/sec execute 314 sec latency 6292.915 ms 2024-03-19T06:29:16.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 868 0.35 MB/sec execute 315 sec latency 7293.059 ms 2024-03-19T06:29:17.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 869 0.35 MB/sec execute 316 sec latency 7936.199 ms 2024-03-19T06:29:18.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 871 0.35 MB/sec execute 317 sec latency 7127.404 ms 2024-03-19T06:29:19.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 872 0.35 MB/sec execute 318 sec latency 8127.534 ms 2024-03-19T06:29:20.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 873 0.35 MB/sec execute 319 sec latency 8323.281 ms 2024-03-19T06:29:21.255 INFO:tasks.workunit.client.0.smithi017.stdout: 10 873 0.35 MB/sec execute 320 sec latency 7935.073 ms 2024-03-19T06:29:22.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 874 0.35 MB/sec execute 321 sec latency 8445.094 ms 2024-03-19T06:29:23.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 875 0.34 MB/sec execute 322 sec latency 9049.054 ms 2024-03-19T06:29:24.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:29:24.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:29:24.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 877 0.34 MB/sec execute 323 sec latency 5260.390 ms 2024-03-19T06:29:25.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 879 0.34 MB/sec execute 324 sec latency 6260.489 ms 2024-03-19T06:29:26.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 882 0.34 MB/sec execute 325 sec latency 7203.169 ms 2024-03-19T06:29:27.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 884 0.34 MB/sec execute 326 sec latency 7346.801 ms 2024-03-19T06:29:28.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 885 0.34 MB/sec execute 327 sec latency 8346.892 ms 2024-03-19T06:29:29.256 INFO:tasks.workunit.client.0.smithi017.stdout: 10 887 0.34 MB/sec execute 328 sec latency 8615.257 ms 2024-03-19T06:29:30.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 889 0.34 MB/sec execute 329 sec latency 3673.107 ms 2024-03-19T06:29:31.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 890 0.34 MB/sec execute 330 sec latency 4673.239 ms 2024-03-19T06:29:32.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 891 0.34 MB/sec execute 331 sec latency 5673.402 ms 2024-03-19T06:29:33.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 892 0.34 MB/sec execute 332 sec latency 6673.513 ms 2024-03-19T06:29:34.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 893 0.33 MB/sec execute 333 sec latency 7462.775 ms 2024-03-19T06:29:35.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 895 0.33 MB/sec execute 334 sec latency 6268.091 ms 2024-03-19T06:29:36.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 897 0.33 MB/sec execute 335 sec latency 6693.044 ms 2024-03-19T06:29:37.257 INFO:tasks.workunit.client.0.smithi017.stdout: 10 897 0.33 MB/sec execute 336 sec latency 7653.627 ms 2024-03-19T06:29:38.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 899 0.33 MB/sec execute 337 sec latency 8494.290 ms 2024-03-19T06:29:38.359 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:07.360 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.367 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:07.369 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.401 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:07.419 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.483 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:24:07.501 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.492 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:24:07.510 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.498 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:07.517 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.555 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:24:07.557 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.644 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:24:07.662 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:38.671 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:24:07.689 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:29:39.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 902 0.33 MB/sec execute 338 sec latency 5191.738 ms 2024-03-19T06:29:40.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 903 0.33 MB/sec execute 339 sec latency 5543.613 ms 2024-03-19T06:29:41.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 906 0.33 MB/sec execute 340 sec latency 5814.324 ms 2024-03-19T06:29:42.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 907 0.33 MB/sec execute 341 sec latency 2648.415 ms 2024-03-19T06:29:43.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 908 0.33 MB/sec execute 342 sec latency 3648.521 ms 2024-03-19T06:29:44.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 910 0.33 MB/sec execute 343 sec latency 4648.652 ms 2024-03-19T06:29:45.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 911 0.32 MB/sec execute 344 sec latency 4695.731 ms 2024-03-19T06:29:46.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 912 0.32 MB/sec execute 345 sec latency 5695.834 ms 2024-03-19T06:29:47.258 INFO:tasks.workunit.client.0.smithi017.stdout: 10 912 0.32 MB/sec execute 346 sec latency 6695.935 ms 2024-03-19T06:29:48.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 913 0.32 MB/sec execute 347 sec latency 7696.081 ms 2024-03-19T06:29:49.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 914 0.32 MB/sec execute 348 sec latency 8475.041 ms 2024-03-19T06:29:50.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 916 0.32 MB/sec execute 349 sec latency 7818.117 ms 2024-03-19T06:29:51.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 917 0.32 MB/sec execute 350 sec latency 4361.995 ms 2024-03-19T06:29:52.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 917 0.32 MB/sec execute 351 sec latency 5362.118 ms 2024-03-19T06:29:53.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 918 0.32 MB/sec execute 352 sec latency 6362.211 ms 2024-03-19T06:29:54.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 919 0.32 MB/sec execute 353 sec latency 6639.771 ms 2024-03-19T06:29:54.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:29:54.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:29:55.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 923 0.32 MB/sec execute 354 sec latency 6268.473 ms 2024-03-19T06:29:56.259 INFO:tasks.workunit.client.0.smithi017.stdout: 10 924 0.32 MB/sec execute 355 sec latency 5864.223 ms 2024-03-19T06:29:57.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 925 0.32 MB/sec execute 356 sec latency 3722.854 ms 2024-03-19T06:29:58.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 926 0.31 MB/sec execute 357 sec latency 4722.958 ms 2024-03-19T06:29:59.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.31 MB/sec execute 358 sec latency 5457.305 ms 2024-03-19T06:30:00.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.31 MB/sec execute 359 sec latency 4679.183 ms 2024-03-19T06:30:01.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.31 MB/sec execute 360 sec latency 5679.340 ms 2024-03-19T06:30:02.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 928 0.31 MB/sec execute 361 sec latency 6679.471 ms 2024-03-19T06:30:03.260 INFO:tasks.workunit.client.0.smithi017.stdout: 10 929 0.31 MB/sec execute 362 sec latency 6937.703 ms 2024-03-19T06:30:04.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 929 0.31 MB/sec execute 363 sec latency 7078.988 ms 2024-03-19T06:30:05.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 929 0.31 MB/sec execute 364 sec latency 5406.694 ms 2024-03-19T06:30:06.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 930 0.31 MB/sec execute 365 sec latency 6406.781 ms 2024-03-19T06:30:07.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 930 0.31 MB/sec execute 366 sec latency 6550.833 ms 2024-03-19T06:30:08.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 931 0.31 MB/sec execute 367 sec latency 4932.944 ms 2024-03-19T06:30:09.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 931 0.31 MB/sec execute 368 sec latency 5549.677 ms 2024-03-19T06:30:10.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 932 0.30 MB/sec execute 369 sec latency 4467.575 ms 2024-03-19T06:30:11.261 INFO:tasks.workunit.client.0.smithi017.stdout: 10 932 0.30 MB/sec execute 370 sec latency 4718.597 ms 2024-03-19T06:30:12.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 934 0.30 MB/sec execute 371 sec latency 5333.239 ms 2024-03-19T06:30:13.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 935 0.30 MB/sec execute 372 sec latency 3200.517 ms 2024-03-19T06:30:14.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 935 0.30 MB/sec execute 373 sec latency 4200.609 ms 2024-03-19T06:30:15.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 937 0.30 MB/sec execute 374 sec latency 4960.588 ms 2024-03-19T06:30:16.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 939 0.30 MB/sec execute 375 sec latency 4957.790 ms 2024-03-19T06:30:17.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 939 0.30 MB/sec execute 376 sec latency 4434.967 ms 2024-03-19T06:30:18.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 940 0.30 MB/sec execute 377 sec latency 5070.529 ms 2024-03-19T06:30:19.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 940 0.30 MB/sec execute 378 sec latency 5714.667 ms 2024-03-19T06:30:20.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 941 0.30 MB/sec execute 379 sec latency 5698.065 ms 2024-03-19T06:30:21.262 INFO:tasks.workunit.client.0.smithi017.stdout: 10 942 0.30 MB/sec execute 380 sec latency 6206.039 ms 2024-03-19T06:30:22.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 943 0.30 MB/sec execute 381 sec latency 6040.680 ms 2024-03-19T06:30:23.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 945 0.29 MB/sec execute 382 sec latency 6437.753 ms 2024-03-19T06:30:24.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 947 0.29 MB/sec execute 383 sec latency 6219.029 ms 2024-03-19T06:30:24.477 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:30:24.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:30:25.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 948 0.29 MB/sec execute 384 sec latency 3981.792 ms 2024-03-19T06:30:26.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 950 0.29 MB/sec execute 385 sec latency 4981.890 ms 2024-03-19T06:30:27.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 952 0.29 MB/sec execute 386 sec latency 5810.926 ms 2024-03-19T06:30:28.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 954 0.29 MB/sec execute 387 sec latency 5914.329 ms 2024-03-19T06:30:29.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 954 0.29 MB/sec execute 388 sec latency 4764.214 ms 2024-03-19T06:30:30.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 955 0.29 MB/sec execute 389 sec latency 5764.330 ms 2024-03-19T06:30:31.263 INFO:tasks.workunit.client.0.smithi017.stdout: 10 956 0.29 MB/sec execute 390 sec latency 6122.007 ms 2024-03-19T06:30:32.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 956 0.29 MB/sec execute 391 sec latency 6291.096 ms 2024-03-19T06:30:33.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 958 0.29 MB/sec execute 392 sec latency 6073.016 ms 2024-03-19T06:30:34.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 961 0.29 MB/sec execute 393 sec latency 5992.039 ms 2024-03-19T06:30:35.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 964 0.29 MB/sec execute 394 sec latency 4312.365 ms 2024-03-19T06:30:36.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 968 0.29 MB/sec execute 395 sec latency 5290.786 ms 2024-03-19T06:30:37.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 971 0.29 MB/sec execute 396 sec latency 4227.024 ms 2024-03-19T06:30:38.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 973 0.29 MB/sec execute 397 sec latency 5227.110 ms 2024-03-19T06:30:39.264 INFO:tasks.workunit.client.0.smithi017.stdout: 10 976 0.29 MB/sec execute 398 sec latency 5613.757 ms 2024-03-19T06:30:40.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 979 0.29 MB/sec execute 399 sec latency 4032.419 ms 2024-03-19T06:30:41.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 981 0.29 MB/sec execute 400 sec latency 4652.125 ms 2024-03-19T06:30:42.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 982 0.29 MB/sec execute 401 sec latency 4715.500 ms 2024-03-19T06:30:43.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 982 0.29 MB/sec execute 402 sec latency 5715.578 ms 2024-03-19T06:30:44.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 984 0.29 MB/sec execute 403 sec latency 6647.957 ms 2024-03-19T06:30:45.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 985 0.28 MB/sec execute 404 sec latency 6746.884 ms 2024-03-19T06:30:46.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 986 0.28 MB/sec execute 405 sec latency 7747.003 ms 2024-03-19T06:30:47.265 INFO:tasks.workunit.client.0.smithi017.stdout: 10 987 0.28 MB/sec execute 406 sec latency 7895.717 ms 2024-03-19T06:30:48.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 988 0.28 MB/sec execute 407 sec latency 5780.859 ms 2024-03-19T06:30:49.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 991 0.28 MB/sec execute 408 sec latency 6780.986 ms 2024-03-19T06:30:50.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 993 0.28 MB/sec execute 409 sec latency 7781.112 ms 2024-03-19T06:30:51.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 995 0.28 MB/sec execute 410 sec latency 8513.510 ms 2024-03-19T06:30:52.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 997 0.28 MB/sec execute 411 sec latency 5715.132 ms 2024-03-19T06:30:53.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1000 0.28 MB/sec execute 412 sec latency 6715.251 ms 2024-03-19T06:30:54.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1002 0.28 MB/sec execute 413 sec latency 7715.380 ms 2024-03-19T06:30:54.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:30:54.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:30:55.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1005 0.28 MB/sec execute 414 sec latency 8715.532 ms 2024-03-19T06:30:56.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1007 0.28 MB/sec execute 415 sec latency 9091.707 ms 2024-03-19T06:30:57.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1008 0.28 MB/sec execute 416 sec latency 8881.948 ms 2024-03-19T06:30:58.266 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1009 0.28 MB/sec execute 417 sec latency 7369.324 ms 2024-03-19T06:30:59.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1010 0.28 MB/sec execute 418 sec latency 8369.428 ms 2024-03-19T06:31:00.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1011 0.28 MB/sec execute 419 sec latency 8403.317 ms 2024-03-19T06:31:01.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1011 0.28 MB/sec execute 420 sec latency 7876.130 ms 2024-03-19T06:31:02.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1011 0.28 MB/sec execute 421 sec latency 8062.785 ms 2024-03-19T06:31:03.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1015 0.28 MB/sec execute 422 sec latency 6637.292 ms 2024-03-19T06:31:04.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1016 0.28 MB/sec execute 423 sec latency 6137.424 ms 2024-03-19T06:31:05.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1022 0.28 MB/sec execute 424 sec latency 6658.093 ms 2024-03-19T06:31:06.267 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1025 0.28 MB/sec execute 425 sec latency 6646.280 ms 2024-03-19T06:31:07.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1027 0.29 MB/sec execute 426 sec latency 6468.939 ms 2024-03-19T06:31:08.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1031 0.29 MB/sec execute 427 sec latency 4862.487 ms 2024-03-19T06:31:09.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1033 0.29 MB/sec execute 428 sec latency 3791.671 ms 2024-03-19T06:31:10.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1033 0.29 MB/sec execute 429 sec latency 4791.784 ms 2024-03-19T06:31:11.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1033 0.29 MB/sec execute 430 sec latency 5553.520 ms 2024-03-19T06:31:12.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1033 0.29 MB/sec execute 431 sec latency 6553.646 ms 2024-03-19T06:31:13.268 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1034 0.29 MB/sec execute 432 sec latency 7078.499 ms 2024-03-19T06:31:14.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1035 0.28 MB/sec execute 433 sec latency 7223.168 ms 2024-03-19T06:31:15.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1036 0.28 MB/sec execute 434 sec latency 6523.542 ms 2024-03-19T06:31:16.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1036 0.28 MB/sec execute 435 sec latency 5901.236 ms 2024-03-19T06:31:17.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1037 0.28 MB/sec execute 436 sec latency 6573.054 ms 2024-03-19T06:31:18.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1038 0.28 MB/sec execute 437 sec latency 4814.975 ms 2024-03-19T06:31:19.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1039 0.28 MB/sec execute 438 sec latency 5125.624 ms 2024-03-19T06:31:20.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1039 0.28 MB/sec execute 439 sec latency 4991.985 ms 2024-03-19T06:31:21.269 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1041 0.28 MB/sec execute 440 sec latency 4705.445 ms 2024-03-19T06:31:22.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1043 0.28 MB/sec execute 441 sec latency 5140.745 ms 2024-03-19T06:31:23.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1044 0.28 MB/sec execute 442 sec latency 5318.823 ms 2024-03-19T06:31:24.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1045 0.28 MB/sec execute 443 sec latency 5665.704 ms 2024-03-19T06:31:24.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:31:24.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:31:25.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1047 0.28 MB/sec execute 444 sec latency 5704.282 ms 2024-03-19T06:31:26.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1047 0.28 MB/sec execute 445 sec latency 5145.120 ms 2024-03-19T06:31:27.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1049 0.28 MB/sec execute 446 sec latency 6145.235 ms 2024-03-19T06:31:28.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1050 0.28 MB/sec execute 447 sec latency 6920.377 ms 2024-03-19T06:31:29.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1050 0.28 MB/sec execute 448 sec latency 5941.667 ms 2024-03-19T06:31:29.357 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:58.359 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.365 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:58.367 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.463 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:25:58.482 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.478 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:25:58.496 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.486 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:58.505 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.491 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:58.510 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.508 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:25:58.510 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.552 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:25:58.571 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:29.563 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:25:58.582 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:31:30.270 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1052 0.28 MB/sec execute 449 sec latency 5388.969 ms 2024-03-19T06:31:31.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1053 0.27 MB/sec execute 450 sec latency 6389.065 ms 2024-03-19T06:31:32.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1055 0.27 MB/sec execute 451 sec latency 7175.014 ms 2024-03-19T06:31:33.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1055 0.27 MB/sec execute 452 sec latency 6874.299 ms 2024-03-19T06:31:34.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1055 0.27 MB/sec execute 453 sec latency 7609.226 ms 2024-03-19T06:31:35.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1056 0.27 MB/sec execute 454 sec latency 7225.858 ms 2024-03-19T06:31:36.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1056 0.27 MB/sec execute 455 sec latency 7567.679 ms 2024-03-19T06:31:37.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1057 0.27 MB/sec execute 456 sec latency 7522.084 ms 2024-03-19T06:31:38.271 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1057 0.27 MB/sec execute 457 sec latency 6214.937 ms 2024-03-19T06:31:39.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1058 0.27 MB/sec execute 458 sec latency 6403.427 ms 2024-03-19T06:31:40.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1059 0.27 MB/sec execute 459 sec latency 5419.128 ms 2024-03-19T06:31:41.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1061 0.27 MB/sec execute 460 sec latency 5494.644 ms 2024-03-19T06:31:42.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1062 0.27 MB/sec execute 461 sec latency 5762.776 ms 2024-03-19T06:31:43.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1062 0.27 MB/sec execute 462 sec latency 6762.906 ms 2024-03-19T06:31:44.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1064 0.27 MB/sec execute 463 sec latency 6947.140 ms 2024-03-19T06:31:45.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1064 0.27 MB/sec execute 464 sec latency 6812.394 ms 2024-03-19T06:31:46.272 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1066 0.27 MB/sec execute 465 sec latency 7039.905 ms 2024-03-19T06:31:47.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1068 0.27 MB/sec execute 466 sec latency 6076.625 ms 2024-03-19T06:31:48.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1069 0.26 MB/sec execute 467 sec latency 7076.725 ms 2024-03-19T06:31:49.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1070 0.26 MB/sec execute 468 sec latency 7204.872 ms 2024-03-19T06:31:50.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1072 0.26 MB/sec execute 469 sec latency 5837.070 ms 2024-03-19T06:31:51.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1074 0.26 MB/sec execute 470 sec latency 6147.508 ms 2024-03-19T06:31:52.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1076 0.26 MB/sec execute 471 sec latency 7106.883 ms 2024-03-19T06:31:53.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1077 0.26 MB/sec execute 472 sec latency 7663.126 ms 2024-03-19T06:31:54.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1078 0.26 MB/sec execute 473 sec latency 4430.823 ms 2024-03-19T06:31:54.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:31:54.890 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:31:55.273 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1078 0.26 MB/sec execute 474 sec latency 5430.973 ms 2024-03-19T06:31:56.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1080 0.26 MB/sec execute 475 sec latency 6431.069 ms 2024-03-19T06:31:57.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1082 0.26 MB/sec execute 476 sec latency 7431.164 ms 2024-03-19T06:31:58.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1083 0.26 MB/sec execute 477 sec latency 8431.262 ms 2024-03-19T06:31:59.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1085 0.26 MB/sec execute 478 sec latency 9302.844 ms 2024-03-19T06:32:00.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1087 0.26 MB/sec execute 479 sec latency 6823.669 ms 2024-03-19T06:32:01.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1091 0.26 MB/sec execute 480 sec latency 7077.541 ms 2024-03-19T06:32:02.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1093 0.26 MB/sec execute 481 sec latency 1623.188 ms 2024-03-19T06:32:03.274 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1095 0.26 MB/sec execute 482 sec latency 2589.882 ms 2024-03-19T06:32:04.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1096 0.26 MB/sec execute 483 sec latency 3590.030 ms 2024-03-19T06:32:05.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1097 0.26 MB/sec execute 484 sec latency 4590.145 ms 2024-03-19T06:32:06.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1098 0.26 MB/sec execute 485 sec latency 5590.252 ms 2024-03-19T06:32:07.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1099 0.26 MB/sec execute 486 sec latency 6590.359 ms 2024-03-19T06:32:08.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1100 0.25 MB/sec execute 487 sec latency 7285.967 ms 2024-03-19T06:32:09.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1101 0.25 MB/sec execute 488 sec latency 5486.509 ms 2024-03-19T06:32:10.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1103 0.25 MB/sec execute 489 sec latency 6415.975 ms 2024-03-19T06:32:11.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1104 0.25 MB/sec execute 490 sec latency 7054.665 ms 2024-03-19T06:32:12.275 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1105 0.25 MB/sec execute 491 sec latency 7198.287 ms 2024-03-19T06:32:13.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1105 0.25 MB/sec execute 492 sec latency 7945.837 ms 2024-03-19T06:32:14.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1108 0.25 MB/sec execute 493 sec latency 8271.127 ms 2024-03-19T06:32:15.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1109 0.25 MB/sec execute 494 sec latency 4293.951 ms 2024-03-19T06:32:16.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1111 0.25 MB/sec execute 495 sec latency 5294.039 ms 2024-03-19T06:32:17.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1112 0.25 MB/sec execute 496 sec latency 6294.145 ms 2024-03-19T06:32:18.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1113 0.25 MB/sec execute 497 sec latency 7294.251 ms 2024-03-19T06:32:19.276 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1113 0.25 MB/sec execute 498 sec latency 8030.072 ms 2024-03-19T06:32:20.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1115 0.25 MB/sec execute 499 sec latency 8547.702 ms 2024-03-19T06:32:21.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1118 0.25 MB/sec execute 500 sec latency 1900.337 ms 2024-03-19T06:32:22.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1119 0.25 MB/sec execute 501 sec latency 2900.417 ms 2024-03-19T06:32:23.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1119 0.25 MB/sec execute 502 sec latency 3900.510 ms 2024-03-19T06:32:24.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1120 0.25 MB/sec execute 503 sec latency 4900.598 ms 2024-03-19T06:32:25.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:32:25.081 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:32:25.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1122 0.25 MB/sec execute 504 sec latency 5652.702 ms 2024-03-19T06:32:26.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1124 0.25 MB/sec execute 505 sec latency 6475.854 ms 2024-03-19T06:32:27.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1127 0.25 MB/sec execute 506 sec latency 6875.440 ms 2024-03-19T06:32:28.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1128 0.25 MB/sec execute 507 sec latency 5988.395 ms 2024-03-19T06:32:29.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1130 0.24 MB/sec execute 508 sec latency 5473.141 ms 2024-03-19T06:32:30.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1130 0.24 MB/sec execute 509 sec latency 3148.671 ms 2024-03-19T06:32:31.277 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1132 0.24 MB/sec execute 510 sec latency 4148.774 ms 2024-03-19T06:32:32.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1134 0.24 MB/sec execute 511 sec latency 5148.880 ms 2024-03-19T06:32:33.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1135 0.24 MB/sec execute 512 sec latency 6066.548 ms 2024-03-19T06:32:34.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1136 0.24 MB/sec execute 513 sec latency 6552.511 ms 2024-03-19T06:32:35.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1137 0.24 MB/sec execute 514 sec latency 6402.484 ms 2024-03-19T06:32:36.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1139 0.24 MB/sec execute 515 sec latency 6558.817 ms 2024-03-19T06:32:37.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1140 0.24 MB/sec execute 516 sec latency 4837.595 ms 2024-03-19T06:32:38.278 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1142 0.24 MB/sec execute 517 sec latency 5718.024 ms 2024-03-19T06:32:39.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1144 0.24 MB/sec execute 518 sec latency 1564.712 ms 2024-03-19T06:32:40.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1146 0.24 MB/sec execute 519 sec latency 2186.437 ms 2024-03-19T06:32:41.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1147 0.24 MB/sec execute 520 sec latency 3120.084 ms 2024-03-19T06:32:42.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1148 0.24 MB/sec execute 521 sec latency 4120.195 ms 2024-03-19T06:32:43.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1149 0.24 MB/sec execute 522 sec latency 5120.303 ms 2024-03-19T06:32:44.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1151 0.24 MB/sec execute 523 sec latency 6120.414 ms 2024-03-19T06:32:45.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1152 0.24 MB/sec execute 524 sec latency 6274.860 ms 2024-03-19T06:32:46.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1155 0.24 MB/sec execute 525 sec latency 2046.474 ms 2024-03-19T06:32:47.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1155 0.24 MB/sec execute 526 sec latency 3046.613 ms 2024-03-19T06:32:48.279 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1156 0.24 MB/sec execute 527 sec latency 3846.047 ms 2024-03-19T06:32:49.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1158 0.24 MB/sec execute 528 sec latency 4846.183 ms 2024-03-19T06:32:50.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1159 0.24 MB/sec execute 529 sec latency 5511.035 ms 2024-03-19T06:32:51.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1161 0.24 MB/sec execute 530 sec latency 5926.842 ms 2024-03-19T06:32:52.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1161 0.23 MB/sec execute 531 sec latency 3892.162 ms 2024-03-19T06:32:53.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1161 0.23 MB/sec execute 532 sec latency 4892.277 ms 2024-03-19T06:32:54.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1162 0.23 MB/sec execute 533 sec latency 5892.405 ms 2024-03-19T06:32:55.211 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:32:55.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:32:55.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1163 0.23 MB/sec execute 534 sec latency 6892.535 ms 2024-03-19T06:32:56.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1163 0.23 MB/sec execute 535 sec latency 7756.478 ms 2024-03-19T06:32:57.280 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1164 0.23 MB/sec execute 536 sec latency 8256.299 ms 2024-03-19T06:32:58.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1165 0.23 MB/sec execute 537 sec latency 7238.450 ms 2024-03-19T06:32:59.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1166 0.23 MB/sec execute 538 sec latency 5590.265 ms 2024-03-19T06:33:00.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1167 0.23 MB/sec execute 539 sec latency 6049.473 ms 2024-03-19T06:33:01.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1170 0.23 MB/sec execute 540 sec latency 5653.930 ms 2024-03-19T06:33:02.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1172 0.23 MB/sec execute 541 sec latency 6261.863 ms 2024-03-19T06:33:03.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1173 0.23 MB/sec execute 542 sec latency 6341.376 ms 2024-03-19T06:33:04.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1174 0.23 MB/sec execute 543 sec latency 7101.568 ms 2024-03-19T06:33:05.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1175 0.23 MB/sec execute 544 sec latency 6559.616 ms 2024-03-19T06:33:06.281 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1176 0.23 MB/sec execute 545 sec latency 6658.923 ms 2024-03-19T06:33:07.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1176 0.23 MB/sec execute 546 sec latency 7354.422 ms 2024-03-19T06:33:08.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1176 0.23 MB/sec execute 547 sec latency 6100.552 ms 2024-03-19T06:33:09.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1177 0.23 MB/sec execute 548 sec latency 7075.108 ms 2024-03-19T06:33:10.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1178 0.23 MB/sec execute 549 sec latency 6240.628 ms 2024-03-19T06:33:11.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1179 0.23 MB/sec execute 550 sec latency 6287.021 ms 2024-03-19T06:33:12.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1179 0.23 MB/sec execute 551 sec latency 7014.882 ms 2024-03-19T06:33:13.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1180 0.23 MB/sec execute 552 sec latency 7081.732 ms 2024-03-19T06:33:14.282 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1181 0.23 MB/sec execute 553 sec latency 7305.496 ms 2024-03-19T06:33:15.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1182 0.23 MB/sec execute 554 sec latency 7874.321 ms 2024-03-19T06:33:16.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1183 0.22 MB/sec execute 555 sec latency 7026.441 ms 2024-03-19T06:33:17.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1184 0.22 MB/sec execute 556 sec latency 7582.763 ms 2024-03-19T06:33:18.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1184 0.22 MB/sec execute 557 sec latency 6629.497 ms 2024-03-19T06:33:18.654 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:27:47.657 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.669 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:27:47.671 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.683 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:47.702 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.683 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:27:47.702 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.689 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:47.709 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.695 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:27:47.714 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.795 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:27:47.815 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.805 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:27:47.808 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:18.809 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:27:47.828 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:33:19.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1186 0.22 MB/sec execute 558 sec latency 7507.436 ms 2024-03-19T06:33:20.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1186 0.22 MB/sec execute 559 sec latency 6956.848 ms 2024-03-19T06:33:21.283 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1188 0.22 MB/sec execute 560 sec latency 4444.325 ms 2024-03-19T06:33:22.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1190 0.22 MB/sec execute 561 sec latency 5444.438 ms 2024-03-19T06:33:23.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1191 0.22 MB/sec execute 562 sec latency 6242.256 ms 2024-03-19T06:33:24.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1192 0.22 MB/sec execute 563 sec latency 5273.384 ms 2024-03-19T06:33:25.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1192 0.22 MB/sec execute 564 sec latency 6273.478 ms 2024-03-19T06:33:25.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:33:25.368 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:33:26.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1194 0.22 MB/sec execute 565 sec latency 7273.577 ms 2024-03-19T06:33:27.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1196 0.22 MB/sec execute 566 sec latency 8013.982 ms 2024-03-19T06:33:28.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1197 0.22 MB/sec execute 567 sec latency 8421.734 ms 2024-03-19T06:33:29.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1197 0.22 MB/sec execute 568 sec latency 3119.893 ms 2024-03-19T06:33:30.284 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1198 0.22 MB/sec execute 569 sec latency 4119.998 ms 2024-03-19T06:33:31.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1199 0.22 MB/sec execute 570 sec latency 4894.829 ms 2024-03-19T06:33:32.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1200 0.22 MB/sec execute 571 sec latency 5483.657 ms 2024-03-19T06:33:33.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1202 0.22 MB/sec execute 572 sec latency 6483.763 ms 2024-03-19T06:33:34.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1205 0.22 MB/sec execute 573 sec latency 6564.453 ms 2024-03-19T06:33:35.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1206 0.22 MB/sec execute 574 sec latency 3466.122 ms 2024-03-19T06:33:36.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1208 0.22 MB/sec execute 575 sec latency 4466.249 ms 2024-03-19T06:33:37.285 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1209 0.22 MB/sec execute 576 sec latency 5466.385 ms 2024-03-19T06:33:38.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1211 0.22 MB/sec execute 577 sec latency 6466.502 ms 2024-03-19T06:33:39.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1213 0.22 MB/sec execute 578 sec latency 7044.913 ms 2024-03-19T06:33:40.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1215 0.22 MB/sec execute 579 sec latency 2156.805 ms 2024-03-19T06:33:41.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1218 0.22 MB/sec execute 580 sec latency 3156.914 ms 2024-03-19T06:33:42.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1219 0.22 MB/sec execute 581 sec latency 4157.019 ms 2024-03-19T06:33:43.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1221 0.22 MB/sec execute 582 sec latency 5157.149 ms 2024-03-19T06:33:44.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1223 0.21 MB/sec execute 583 sec latency 6157.273 ms 2024-03-19T06:33:45.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1224 0.21 MB/sec execute 584 sec latency 7157.355 ms 2024-03-19T06:33:46.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1226 0.21 MB/sec execute 585 sec latency 7874.466 ms 2024-03-19T06:33:47.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1227 0.21 MB/sec execute 586 sec latency 6883.391 ms 2024-03-19T06:33:48.286 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1228 0.21 MB/sec execute 587 sec latency 4959.097 ms 2024-03-19T06:33:49.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1228 0.21 MB/sec execute 588 sec latency 5959.215 ms 2024-03-19T06:33:50.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1229 0.21 MB/sec execute 589 sec latency 6959.329 ms 2024-03-19T06:33:51.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1229 0.21 MB/sec execute 590 sec latency 7959.440 ms 2024-03-19T06:33:52.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1230 0.21 MB/sec execute 591 sec latency 8627.634 ms 2024-03-19T06:33:53.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1231 0.21 MB/sec execute 592 sec latency 7360.027 ms 2024-03-19T06:33:54.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1233 0.21 MB/sec execute 593 sec latency 8360.195 ms 2024-03-19T06:33:55.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1235 0.21 MB/sec execute 594 sec latency 9360.297 ms 2024-03-19T06:33:55.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:33:55.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:33:56.287 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1236 0.21 MB/sec execute 595 sec latency 10360.416 ms 2024-03-19T06:33:57.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1237 0.21 MB/sec execute 596 sec latency 10548.350 ms 2024-03-19T06:33:58.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1239 0.21 MB/sec execute 597 sec latency 6056.832 ms 2024-03-19T06:33:59.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1240 0.21 MB/sec execute 598 sec latency 7056.960 ms 2024-03-19T06:34:00.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 1241 0.21 MB/sec execute 599 sec latency 8057.075 ms 2024-03-19T06:34:01.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 600 sec 2024-03-19T06:34:02.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 601 sec 2024-03-19T06:34:03.288 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 602 sec 2024-03-19T06:34:04.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 603 sec 2024-03-19T06:34:05.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 604 sec 2024-03-19T06:34:06.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 605 sec 2024-03-19T06:34:07.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 606 sec 2024-03-19T06:34:08.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 607 sec 2024-03-19T06:34:09.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 608 sec 2024-03-19T06:34:10.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 609 sec 2024-03-19T06:34:11.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 610 sec 2024-03-19T06:34:12.289 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 611 sec 2024-03-19T06:34:13.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 612 sec 2024-03-19T06:34:14.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 613 sec 2024-03-19T06:34:15.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 614 sec 2024-03-19T06:34:16.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 615 sec 2024-03-19T06:34:17.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 616 sec 2024-03-19T06:34:18.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 617 sec 2024-03-19T06:34:19.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 618 sec 2024-03-19T06:34:20.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 619 sec 2024-03-19T06:34:21.290 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 620 sec 2024-03-19T06:34:22.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 621 sec 2024-03-19T06:34:23.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 622 sec 2024-03-19T06:34:24.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 623 sec 2024-03-19T06:34:25.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 624 sec 2024-03-19T06:34:25.684 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:34:25.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:34:26.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 625 sec 2024-03-19T06:34:27.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 626 sec 2024-03-19T06:34:28.291 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 627 sec 2024-03-19T06:34:29.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 628 sec 2024-03-19T06:34:30.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 629 sec 2024-03-19T06:34:31.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 630 sec 2024-03-19T06:34:32.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 631 sec 2024-03-19T06:34:33.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 632 sec 2024-03-19T06:34:34.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 633 sec 2024-03-19T06:34:35.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 634 sec 2024-03-19T06:34:36.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 635 sec 2024-03-19T06:34:37.292 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 636 sec 2024-03-19T06:34:38.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 637 sec 2024-03-19T06:34:39.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 638 sec 2024-03-19T06:34:40.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 639 sec 2024-03-19T06:34:41.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 640 sec 2024-03-19T06:34:42.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 641 sec 2024-03-19T06:34:43.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 642 sec 2024-03-19T06:34:44.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 643 sec 2024-03-19T06:34:45.293 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 644 sec 2024-03-19T06:34:46.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 645 sec 2024-03-19T06:34:47.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 646 sec 2024-03-19T06:34:48.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 647 sec 2024-03-19T06:34:49.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 648 sec 2024-03-19T06:34:50.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 649 sec 2024-03-19T06:34:51.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 650 sec 2024-03-19T06:34:52.294 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 651 sec 2024-03-19T06:34:53.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 652 sec 2024-03-19T06:34:54.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 653 sec 2024-03-19T06:34:55.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 654 sec 2024-03-19T06:34:55.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:34:55.833 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:34:56.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 655 sec 2024-03-19T06:34:57.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 656 sec 2024-03-19T06:34:58.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 657 sec 2024-03-19T06:34:59.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 658 sec 2024-03-19T06:35:00.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 659 sec 2024-03-19T06:35:01.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 660 sec 2024-03-19T06:35:02.295 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 661 sec 2024-03-19T06:35:03.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 662 sec 2024-03-19T06:35:04.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 663 sec 2024-03-19T06:35:05.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 664 sec 2024-03-19T06:35:06.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 665 sec 2024-03-19T06:35:07.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 666 sec 2024-03-19T06:35:08.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 667 sec 2024-03-19T06:35:09.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 668 sec 2024-03-19T06:35:10.296 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 669 sec 2024-03-19T06:35:11.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 670 sec 2024-03-19T06:35:12.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 671 sec 2024-03-19T06:35:13.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 672 sec 2024-03-19T06:35:14.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 673 sec 2024-03-19T06:35:15.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 674 sec 2024-03-19T06:35:16.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 675 sec 2024-03-19T06:35:17.298 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 676 sec 2024-03-19T06:35:18.297 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 677 sec 2024-03-19T06:35:19.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 678 sec 2024-03-19T06:35:20.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 679 sec 2024-03-19T06:35:21.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 680 sec 2024-03-19T06:35:22.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 681 sec 2024-03-19T06:35:23.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 682 sec 2024-03-19T06:35:24.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 683 sec 2024-03-19T06:35:25.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 684 sec 2024-03-19T06:35:25.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:35:25.971 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:35:26.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 685 sec 2024-03-19T06:35:27.299 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 686 sec 2024-03-19T06:35:28.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 687 sec 2024-03-19T06:35:29.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 688 sec 2024-03-19T06:35:30.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 689 sec 2024-03-19T06:35:31.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 690 sec 2024-03-19T06:35:32.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 691 sec 2024-03-19T06:35:33.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 692 sec 2024-03-19T06:35:34.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 693 sec 2024-03-19T06:35:35.300 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 694 sec 2024-03-19T06:35:36.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 695 sec 2024-03-19T06:35:37.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 696 sec 2024-03-19T06:35:38.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 697 sec 2024-03-19T06:35:39.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 698 sec 2024-03-19T06:35:40.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 699 sec 2024-03-19T06:35:41.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 700 sec 2024-03-19T06:35:42.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 701 sec 2024-03-19T06:35:43.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 702 sec 2024-03-19T06:35:44.301 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 703 sec 2024-03-19T06:35:45.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 704 sec 2024-03-19T06:35:46.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 705 sec 2024-03-19T06:35:47.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 706 sec 2024-03-19T06:35:48.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 707 sec 2024-03-19T06:35:49.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 708 sec 2024-03-19T06:35:50.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 709 sec 2024-03-19T06:35:51.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 710 sec 2024-03-19T06:35:52.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 711 sec 2024-03-19T06:35:53.302 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 712 sec 2024-03-19T06:35:54.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 713 sec 2024-03-19T06:35:55.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 714 sec 2024-03-19T06:35:56.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:35:56.108 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:35:56.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 715 sec 2024-03-19T06:35:57.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 716 sec 2024-03-19T06:35:58.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 717 sec 2024-03-19T06:35:59.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 718 sec 2024-03-19T06:36:00.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 719 sec 2024-03-19T06:36:01.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 720 sec 2024-03-19T06:36:02.303 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 721 sec 2024-03-19T06:36:03.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 722 sec 2024-03-19T06:36:04.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 723 sec 2024-03-19T06:36:05.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 724 sec 2024-03-19T06:36:06.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 725 sec 2024-03-19T06:36:07.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 726 sec 2024-03-19T06:36:08.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 727 sec 2024-03-19T06:36:09.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 728 sec 2024-03-19T06:36:10.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 729 sec 2024-03-19T06:36:11.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 730 sec 2024-03-19T06:36:12.304 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 731 sec 2024-03-19T06:36:13.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 732 sec 2024-03-19T06:36:14.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 733 sec 2024-03-19T06:36:15.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 734 sec 2024-03-19T06:36:16.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 735 sec 2024-03-19T06:36:17.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 736 sec 2024-03-19T06:36:18.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 737 sec 2024-03-19T06:36:19.305 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 738 sec 2024-03-19T06:36:20.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 739 sec 2024-03-19T06:36:21.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 740 sec 2024-03-19T06:36:22.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 741 sec 2024-03-19T06:36:23.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 742 sec 2024-03-19T06:36:24.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 743 sec 2024-03-19T06:36:25.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 744 sec 2024-03-19T06:36:26.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:36:26.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:36:26.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 745 sec 2024-03-19T06:36:27.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 746 sec 2024-03-19T06:36:28.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 747 sec 2024-03-19T06:36:29.306 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 748 sec 2024-03-19T06:36:30.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 749 sec 2024-03-19T06:36:31.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 750 sec 2024-03-19T06:36:32.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 751 sec 2024-03-19T06:36:33.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 752 sec 2024-03-19T06:36:34.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 753 sec 2024-03-19T06:36:35.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 754 sec 2024-03-19T06:36:36.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 755 sec 2024-03-19T06:36:37.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 756 sec 2024-03-19T06:36:38.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 757 sec 2024-03-19T06:36:39.307 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 758 sec 2024-03-19T06:36:40.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 759 sec 2024-03-19T06:36:41.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 760 sec 2024-03-19T06:36:42.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 761 sec 2024-03-19T06:36:43.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 762 sec 2024-03-19T06:36:44.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 763 sec 2024-03-19T06:36:45.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 764 sec 2024-03-19T06:36:46.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 765 sec 2024-03-19T06:36:47.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 766 sec 2024-03-19T06:36:48.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 767 sec 2024-03-19T06:36:49.308 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 768 sec 2024-03-19T06:36:50.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 769 sec 2024-03-19T06:36:51.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 770 sec 2024-03-19T06:36:52.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 771 sec 2024-03-19T06:36:53.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 772 sec 2024-03-19T06:36:54.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 773 sec 2024-03-19T06:36:55.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 774 sec 2024-03-19T06:36:56.309 INFO:tasks.workunit.client.0.smithi017.stdout: 10 cleanup 775 sec 2024-03-19T06:36:56.586 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:36:56.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:36:57.309 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 776 sec 2024-03-19T06:36:58.310 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 777 sec 2024-03-19T06:36:59.310 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 778 sec 2024-03-19T06:37:00.310 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 779 sec 2024-03-19T06:37:01.310 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 780 sec 2024-03-19T06:37:02.310 INFO:tasks.workunit.client.0.smithi017.stdout: 9 cleanup 781 sec 2024-03-19T06:37:03.310 INFO:tasks.workunit.client.0.smithi017.stdout: 8 cleanup 782 sec 2024-03-19T06:37:04.310 INFO:tasks.workunit.client.0.smithi017.stdout: 7 cleanup 783 sec 2024-03-19T06:37:05.310 INFO:tasks.workunit.client.0.smithi017.stdout: 7 cleanup 784 sec 2024-03-19T06:37:06.310 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 785 sec 2024-03-19T06:37:07.311 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 786 sec 2024-03-19T06:37:08.311 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 787 sec 2024-03-19T06:37:09.311 INFO:tasks.workunit.client.0.smithi017.stdout: 6 cleanup 788 sec 2024-03-19T06:37:10.311 INFO:tasks.workunit.client.0.smithi017.stdout: 5 cleanup 789 sec 2024-03-19T06:37:11.311 INFO:tasks.workunit.client.0.smithi017.stdout: 4 cleanup 790 sec 2024-03-19T06:37:12.311 INFO:tasks.workunit.client.0.smithi017.stdout: 4 cleanup 791 sec 2024-03-19T06:37:13.311 INFO:tasks.workunit.client.0.smithi017.stdout: 3 cleanup 792 sec 2024-03-19T06:37:14.311 INFO:tasks.workunit.client.0.smithi017.stdout: 3 cleanup 793 sec 2024-03-19T06:37:15.311 INFO:tasks.workunit.client.0.smithi017.stdout: 3 cleanup 794 sec 2024-03-19T06:37:16.312 INFO:tasks.workunit.client.0.smithi017.stdout: 2 cleanup 795 sec 2024-03-19T06:37:17.312 INFO:tasks.workunit.client.0.smithi017.stdout: 1 cleanup 796 sec 2024-03-19T06:37:17.940 INFO:tasks.workunit.client.0.smithi017.stdout: 0 cleanup 797 sec 2024-03-19T06:37:17.940 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:37:17.940 INFO:tasks.workunit.client.0.smithi017.stdout: Operation Count AvgLat MaxLat 2024-03-19T06:37:17.940 INFO:tasks.workunit.client.0.smithi017.stdout: ---------------------------------------- 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: NTCreateX 1372 1544.588 6404.325 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Close 1274 11.154 167.022 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Rename 90 2748.496 4663.607 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Unlink 149 935.929 1941.726 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Qpathinfo 831 660.784 4653.597 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Qfileinfo 585 40.706 282.035 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Qfsinfo 290 96.857 328.432 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Sfileinfo 300 222.017 584.122 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Find 380 6479.445 10881.039 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: WriteX 2815 60.831 807.979 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: ReadX 1283 0.355 34.065 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: Flush 240 826.710 2167.314 2024-03-19T06:37:17.941 INFO:tasks.workunit.client.0.smithi017.stdout: 2024-03-19T06:37:17.942 INFO:tasks.workunit.client.0.smithi017.stdout:Throughput 0.209399 MB/sec 10 clients 10 procs max_latency=10881.060 ms 2024-03-19T06:37:17.943 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-19T06:37:17.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-19T06:37:26.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:37:26.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:37:26.868 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:31:55.871 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:26.876 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:31:55.879 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:26.898 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:55.917 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:26.903 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:55.923 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:26.904 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:31:55.923 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:26.915 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:31:55.934 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:27.004 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:31:56.006 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:27.064 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:31:56.083 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:27.075 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:31:56.095 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:56.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:37:56.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:37:57.182 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:32:26.185 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.298 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:26.317 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.299 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:32:26.302 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.308 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:26.328 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.370 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:32:26.390 36864== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.400 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:32:26.403 36692== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.410 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:32:26.430 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.424 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:32:26.444 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:37:57.490 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:32:26.510 36865== Warning: unimplemented fcntl command: 1036 2024-03-19T06:38:22.664 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-03-19T06:38:22.665 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-19T06:38:23.739 DEBUG:teuthology.parallel:result is None 2024-03-19T06:38:23.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-19T06:38:24.272 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-19T06:38:24.272 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-19T06:38:24.281 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-19T06:38:24.281 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:38:24.282 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:38:24.340 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:38:24.340 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:38:24.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:38:24.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.891+0000 7f4dc8800640 1 Processor -- start 2024-03-19T06:38:24.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.891+0000 7f4dc8800640 1 -- start start 2024-03-19T06:38:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.893+0000 7f4dc8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4dc00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.893+0000 7f4dc8800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00c27c0 con 0x7f4dc0151f70 2024-03-19T06:38:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.893+0000 7f4dc8800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc0157be0 con 0x7f4dc015b1d0 2024-03-19T06:38:24.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.893+0000 7f4dc8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0157f30 con 0x7f4dc00c1e60 2024-03-19T06:38:24.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.894+0000 7f4dc5e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4dc0151f70 0x7f4dc01583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39322/0 (socket says 172.21.15.17:39322) 2024-03-19T06:38:24.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.894+0000 7f4dc5e00640 1 -- 172.21.15.17:0/3746414871 learned_addr learned my addr 172.21.15.17:0/3746414871 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:24.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.895+0000 7f4dc6800640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4dc00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.898+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297453990 0 0) 0x7f4dc00c27c0 con 0x7f4dc0151f70 2024-03-19T06:38:24.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.898+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4da8003520 con 0x7f4dc0151f70 2024-03-19T06:38:24.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.900+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385592315 0 0) 0x7f4dc0157be0 con 0x7f4dc015b1d0 2024-03-19T06:38:24.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.900+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc00c27c0 con 0x7f4dc015b1d0 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057991270 0 0) 0x7f4da8003520 con 0x7f4dc0151f70 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 msgr2=0x7f4dc00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4dc00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 >> v1:172.21.15.153:6789/0 conn(0x7f4dc015b1d0 legacy=0x7f4dc006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc015b730 con 0x7f4dc0151f70 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.902+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f4db4001670 con 0x7f4dc0151f70 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 >> v1:172.21.15.17:6789/0 conn(0x7f4dc0151f70 legacy=0x7f4dc01583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:24.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4da8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da8004800 0x7f4da8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4da80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0157f30 con 0x7f4da8003b70 2024-03-19T06:38:24.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da800ba70 con 0x7f4da8004800 2024-03-19T06:38:24.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.903+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da800bc70 con 0x7f4dc00c1e60 2024-03-19T06:38:24.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.905+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4da8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.909+0000 7f4dc6800640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4da80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.911+0000 7f4dc5e00640 1 -- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 msgr2=0x7f4da80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:24.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.911+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc00c1e60 0x7f4da80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:24.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.911+0000 7f4dc5e00640 1 -- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da8004800 msgr2=0x7f4da8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:24.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.911+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4da8004800 0x7f4da8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:24.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.911+0000 7f4dc5e00640 1 -- 172.21.15.17:0/3746414871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8003520 con 0x7f4da8003b70 2024-03-19T06:38:24.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.915+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4da8003f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c0e0 tx=0x7f4da8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1abef47b751c43 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.921+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007c40 con 0x7f4da8003b70 2024-03-19T06:38:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.921+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4030070 con 0x7f4da8003b70 2024-03-19T06:38:24.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.921+0000 7f4dc4a00640 1 -- 172.21.15.17:0/3746414871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4005d50 con 0x7f4da8003b70 2024-03-19T06:38:24.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 -- 172.21.15.17:0/3746414871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 msgr2=0x7f4da8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 --2- 172.21.15.17:0/3746414871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4da8003f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c0e0 tx=0x7f4da8005830 comp rx=0 tx=0).stop 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc6800640 1 -- 172.21.15.17:0/3746414871 reap_dead start 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 -- 172.21.15.17:0/3746414871 shutdown_connections 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 -- 172.21.15.17:0/3746414871 >> 172.21.15.17:0/3746414871 conn(0x7f4dc00c8910 msgr2=0x7f4dc00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 -- 172.21.15.17:0/3746414871 shutdown_connections 2024-03-19T06:38:24.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.922+0000 7f4dc8800640 1 -- 172.21.15.17:0/3746414871 wait complete. 2024-03-19T06:38:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.926+0000 7f4dc8800640 1 Processor -- start 2024-03-19T06:38:24.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.926+0000 7f4dc8800640 1 -- start start 2024-03-19T06:38:24.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc0155a50 0x7f4dc0146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc0156880 0x7f4dc0147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc015bcf0 con 0x7f4da8003b70 2024-03-19T06:38:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc0152350 con 0x7f4dc0155a50 2024-03-19T06:38:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.928+0000 7f4dc8800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc015bfd0 con 0x7f4dc0156880 2024-03-19T06:38:24.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.929+0000 7f4dc5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.929+0000 7f4dc5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35686/0 (socket says 172.21.15.17:35686) 2024-03-19T06:38:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.930+0000 7f4dc5e00640 1 -- 172.21.15.17:0/2506131041 learned_addr learned my addr 172.21.15.17:0/2506131041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.930+0000 7f4dc6800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc0156880 0x7f4dc0147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.930+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc0155a50 0x7f4dc0146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.935+0000 7f4dc5e00640 1 -- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc0156880 msgr2=0x7f4dc0147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.935+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc0156880 0x7f4dc0147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.935+0000 7f4dc5e00640 1 -- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc0155a50 msgr2=0x7f4dc0146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.935+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc0155a50 0x7f4dc0146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.935+0000 7f4dc5e00640 1 -- 172.21.15.17:0/2506131041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc00cb010 con 0x7f4da8003b70 2024-03-19T06:38:24.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.937+0000 7f4dc5e00640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c0e0 tx=0x7f4db4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.942+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007c40 con 0x7f4da8003b70 2024-03-19T06:38:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.942+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4004bf0 con 0x7f4da8003b70 2024-03-19T06:38:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.942+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007070 con 0x7f4da8003b70 2024-03-19T06:38:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.943+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc00cb2d0 con 0x7f4da8003b70 2024-03-19T06:38:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.943+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc0156f60 con 0x7f4da8003b70 2024-03-19T06:38:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.944+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc0069be0 con 0x7f4da8003b70 2024-03-19T06:38:24.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.976+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4db4047020 con 0x7f4da8003b70 2024-03-19T06:38:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.978+0000 7f4dba000640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 0x7f4da406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:24.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.978+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 0x7f4da406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:24.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.980+0000 7f4dc5400640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 0x7f4da406e0e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dc01557a0 tx=0x7f4db0007d40 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:24.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:24.981+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4db4078630 con 0x7f4da8003b70 2024-03-19T06:38:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.322+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4db407a590 con 0x7f4da8003b70 2024-03-19T06:38:25.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.552+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc00c7200 con 0x7f4da8003b70 2024-03-19T06:38:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.641+0000 7f4dba000640 1 -- 172.21.15.17:0/2506131041 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f4db407e630 con 0x7f4da8003b70 2024-03-19T06:38:25.627 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:25.627 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:38:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 msgr2=0x7f4da406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 0x7f4da406e0e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dc01557a0 tx=0x7f4db0007d40 comp rx=0 tx=0).stop 2024-03-19T06:38:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 msgr2=0x7f4dc00c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c0e0 tx=0x7f4db4001970 comp rx=0 tx=0).stop 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 shutdown_connections 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4dc0156880 0x7f4dc0147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4da406bc20 0x7f4da406e0e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dc0155a50 0x7f4dc0146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 --2- 172.21.15.17:0/2506131041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4da8003b70 0x7f4dc00c60f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 >> 172.21.15.17:0/2506131041 conn(0x7f4dc00c8910 msgr2=0x7f4dc014c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.645+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 shutdown_connections 2024-03-19T06:38:25.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.646+0000 7f4dc8800640 1 -- 172.21.15.17:0/2506131041 wait complete. 2024-03-19T06:38:25.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:38:25.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:38:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.880+0000 7f72e1000640 1 Processor -- start 2024-03-19T06:38:25.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.880+0000 7f72e1000640 1 -- start start 2024-03-19T06:38:25.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.881+0000 7f72e1000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72dc06cf30 0x7f72dc163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:25.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.881+0000 7f72e1000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc0c6270 con 0x7f72dc151eb0 2024-03-19T06:38:25.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.881+0000 7f72e1000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc0c2150 con 0x7f72dc158690 2024-03-19T06:38:25.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.881+0000 7f72e1000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc15c170 con 0x7f72dc06cf30 2024-03-19T06:38:25.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.883+0000 7f72da800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72dc06cf30 0x7f72dc163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:25.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.884+0000 7f72da800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f72dc06cf30 0x7f72dc163560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35690/0 (socket says 172.21.15.17:35690) 2024-03-19T06:38:25.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.884+0000 7f72da800640 1 -- 172.21.15.17:0/1967519352 learned_addr learned my addr 172.21.15.17:0/1967519352 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:25.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.888+0000 7f72da800640 1 -- 172.21.15.17:0/1967519352 >> v1:172.21.15.153:6789/0 conn(0x7f72dc158690 legacy=0x7f72dc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:25.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.888+0000 7f72da800640 1 -- 172.21.15.17:0/1967519352 >> v1:172.21.15.17:6789/0 conn(0x7f72dc151eb0 legacy=0x7f72dc15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.888+0000 7f72da800640 1 -- 172.21.15.17:0/1967519352 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0c2430 con 0x7f72dc06cf30 2024-03-19T06:38:25.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.893+0000 7f72da800640 1 --2- 172.21.15.17:0/1967519352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc163560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009870 tx=0x7f72d402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32a1619d37d7d14 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.897+0000 7f72d8a00640 1 -- 172.21.15.17:0/1967519352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d402f840 con 0x7f72dc06cf30 2024-03-19T06:38:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.898+0000 7f72d8a00640 1 -- 172.21.15.17:0/1967519352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d402f9e0 con 0x7f72dc06cf30 2024-03-19T06:38:25.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.898+0000 7f72d8a00640 1 -- 172.21.15.17:0/1967519352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d402fdb0 con 0x7f72dc06cf30 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.898+0000 7f72e1000640 1 -- 172.21.15.17:0/1967519352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 msgr2=0x7f72dc163560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.898+0000 7f72e1000640 1 --2- 172.21.15.17:0/1967519352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc163560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009870 tx=0x7f72d402ba20 comp rx=0 tx=0).stop 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.899+0000 7f72e1000640 1 -- 172.21.15.17:0/1967519352 shutdown_connections 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.899+0000 7f72e1000640 1 --2- 172.21.15.17:0/1967519352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc163560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.899+0000 7f72e1000640 1 -- 172.21.15.17:0/1967519352 >> 172.21.15.17:0/1967519352 conn(0x7f72dc0cbe10 msgr2=0x7f72dc06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.899+0000 7f72e1000640 1 -- 172.21.15.17:0/1967519352 shutdown_connections 2024-03-19T06:38:25.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.899+0000 7f72e1000640 1 -- 172.21.15.17:0/1967519352 wait complete. 2024-03-19T06:38:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.900+0000 7f72e1000640 1 Processor -- start 2024-03-19T06:38:25.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 -- start start 2024-03-19T06:38:25.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc151eb0 0x7f72dc157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc158690 0x7f72dc06e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc158ae0 con 0x7f72dc06cf30 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc15b540 con 0x7f72dc158690 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.901+0000 7f72e1000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc152290 con 0x7f72dc151eb0 2024-03-19T06:38:25.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.902+0000 7f72d9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.903+0000 7f72d9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35692/0 (socket says 172.21.15.17:35692) 2024-03-19T06:38:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.903+0000 7f72d9e00640 1 -- 172.21.15.17:0/1344554605 learned_addr learned my addr 172.21.15.17:0/1344554605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.903+0000 7f72da800640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc158690 0x7f72dc06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:25.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.904+0000 7f72d9400640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc151eb0 0x7f72dc157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:25.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.907+0000 7f72d9e00640 1 -- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc151eb0 msgr2=0x7f72dc157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.907+0000 7f72d9e00640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc151eb0 0x7f72dc157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.907+0000 7f72d9e00640 1 -- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc158690 msgr2=0x7f72dc06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:25.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.907+0000 7f72d9e00640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc158690 0x7f72dc06e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:25.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.907+0000 7f72d9e00640 1 -- 172.21.15.17:0/1344554605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0c9ad0 con 0x7f72dc06cf30 2024-03-19T06:38:25.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.910+0000 7f72d9e00640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c430 tx=0x7f72c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.914+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40052d0 con 0x7f72dc06cf30 2024-03-19T06:38:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.914+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4005490 con 0x7f72dc06cf30 2024-03-19T06:38:25.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.914+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0c9db0 con 0x7f72dc06cf30 2024-03-19T06:38:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.914+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4007260 con 0x7f72dc06cf30 2024-03-19T06:38:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.914+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc0caec0 con 0x7f72dc06cf30 2024-03-19T06:38:25.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.916+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc0ca9d0 con 0x7f72dc06cf30 2024-03-19T06:38:25.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.938+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f72c4007400 con 0x7f72dc06cf30 2024-03-19T06:38:25.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.939+0000 7f72d2000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 0x7f72b806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:25.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.940+0000 7f72d9400640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 0x7f72b806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:25.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:25.941+0000 7f72d9400640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 0x7f72b806e0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f72dc156ed0 tx=0x7f72cc003d90 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:26.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.265+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f72c4056940 con 0x7f72dc06cf30 2024-03-19T06:38:26.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.266+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f72c40588a0 con 0x7f72dc06cf30 2024-03-19T06:38:26.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.495+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f72dc069be0 con 0x7f72dc06cf30 2024-03-19T06:38:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.571+0000 7f72d2000640 1 -- 172.21.15.17:0/1344554605 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72c405c940 con 0x7f72dc06cf30 2024-03-19T06:38:26.557 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:38:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 msgr2=0x7f72b806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 0x7f72b806e0e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f72dc156ed0 tx=0x7f72cc003d90 comp rx=0 tx=0).stop 2024-03-19T06:38:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 msgr2=0x7f72dc0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f72c400c430 tx=0x7f72c400c8f0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 shutdown_connections 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f72b806bc20 0x7f72b806e0e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72dc158690 0x7f72dc06e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f72dc151eb0 0x7f72dc157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 --2- 172.21.15.17:0/1344554605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72dc06cf30 0x7f72dc0ca260 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 >> 172.21.15.17:0/1344554605 conn(0x7f72dc0cbe10 msgr2=0x7f72dc0c27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.575+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 shutdown_connections 2024-03-19T06:38:26.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.576+0000 7f72e1000640 1 -- 172.21.15.17:0/1344554605 wait complete. 2024-03-19T06:38:26.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:38:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.819+0000 7f62db200640 1 Processor -- start 2024-03-19T06:38:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.820+0000 7f62db200640 1 -- start start 2024-03-19T06:38:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.821+0000 7f62db200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.821+0000 7f62db200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62d415b1d0 0x7f62d41583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.821+0000 7f62db200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d40c27c0 con 0x7f62d4158900 2024-03-19T06:38:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.821+0000 7f62db200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d4157f30 con 0x7f62d415b1d0 2024-03-19T06:38:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.821+0000 7f62db200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d4152350 con 0x7f62d4151f70 2024-03-19T06:38:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.822+0000 7f62cbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62d415b1d0 0x7f62d41583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.822+0000 7f62d9200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f62d4158900 0x7f62d406e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39338/0 (socket says 172.21.15.17:39338) 2024-03-19T06:38:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.822+0000 7f62d9200640 1 -- 172.21.15.17:0/1840848379 learned_addr learned my addr 172.21.15.17:0/1840848379 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.822+0000 7f62d3e00640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.827+0000 7f62cbe00640 1 -- 172.21.15.17:0/1840848379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 msgr2=0x7f62d40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.827+0000 7f62cbe00640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d40c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.827+0000 7f62cbe00640 1 -- 172.21.15.17:0/1840848379 >> v1:172.21.15.17:6789/0 conn(0x7f62d4158900 legacy=0x7f62d406e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.828+0000 7f62cbe00640 1 -- 172.21.15.17:0/1840848379 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4157be0 con 0x7f62d415b1d0 2024-03-19T06:38:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.833+0000 7f62cbe00640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d415b1d0 0x7f62d41583c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097a0 tx=0x7f62bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82de8cc3365ecb26 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.838+0000 7f62d3400640 1 -- 172.21.15.17:0/1840848379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc034070 con 0x7f62d415b1d0 2024-03-19T06:38:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.838+0000 7f62d3400640 1 -- 172.21.15.17:0/1840848379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc030610 con 0x7f62d415b1d0 2024-03-19T06:38:26.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.838+0000 7f62d3400640 1 -- 172.21.15.17:0/1840848379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0309e0 con 0x7f62d415b1d0 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 -- 172.21.15.17:0/1840848379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d415b1d0 msgr2=0x7f62d41583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d415b1d0 0x7f62d41583c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0097a0 tx=0x7f62bc02b960 comp rx=0 tx=0).stop 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 -- 172.21.15.17:0/1840848379 shutdown_connections 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d415b1d0 0x7f62d41583c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 --2- 172.21.15.17:0/1840848379 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 -- 172.21.15.17:0/1840848379 >> 172.21.15.17:0/1840848379 conn(0x7f62d40c8910 msgr2=0x7f62d40cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 -- 172.21.15.17:0/1840848379 shutdown_connections 2024-03-19T06:38:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.839+0000 7f62db200640 1 -- 172.21.15.17:0/1840848379 wait complete. 2024-03-19T06:38:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.841+0000 7f62db200640 1 Processor -- start 2024-03-19T06:38:26.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.842+0000 7f62db200640 1 -- start start 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d41e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d415b1d0 0x7f62d41e3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d415bcf0 con 0x7f62d4158900 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d415ba10 con 0x7f62d415b1d0 2024-03-19T06:38:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.843+0000 7f62db200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d415bfd0 con 0x7f62d4151f70 2024-03-19T06:38:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.844+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.844+0000 7f62cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35710/0 (socket says 172.21.15.17:35710) 2024-03-19T06:38:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.844+0000 7f62cbe00640 1 -- 172.21.15.17:0/2248044927 learned_addr learned my addr 172.21.15.17:0/2248044927 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.845+0000 7f62d9200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d415b1d0 0x7f62d41e3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:26.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.845+0000 7f62d3e00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d41e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.848+0000 7f62cbe00640 1 -- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 msgr2=0x7f62d41e1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.848+0000 7f62cbe00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d41e1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.848+0000 7f62cbe00640 1 -- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d415b1d0 msgr2=0x7f62d41e3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.848+0000 7f62cbe00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d415b1d0 0x7f62d41e3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.848+0000 7f62cbe00640 1 -- 172.21.15.17:0/2248044927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d41f0200 con 0x7f62d4158900 2024-03-19T06:38:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.851+0000 7f62cbe00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62bc02bf70 tx=0x7f62bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.856+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc034040 con 0x7f62d4158900 2024-03-19T06:38:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.856+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc03ac40 con 0x7f62d4158900 2024-03-19T06:38:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.856+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0443f0 con 0x7f62d4158900 2024-03-19T06:38:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.856+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d41f04e0 con 0x7f62d4158900 2024-03-19T06:38:26.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.856+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d41f0aa0 con 0x7f62d4158900 2024-03-19T06:38:26.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:26.857+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d41f0ce0 con 0x7f62d4158900 2024-03-19T06:38:26.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:38:26.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:38:27.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.152+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f62bc037070 con 0x7f62d4158900 2024-03-19T06:38:27.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.153+0000 7f62d0c00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 0x7f62b006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.153+0000 7f62d3e00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 0x7f62b006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:27.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.155+0000 7f62d3e00640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 0x7f62b006e0e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009a10 tx=0x7f62c4008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:27.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.166+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f62bc0796a0 con 0x7f62d4158900 2024-03-19T06:38:27.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.167+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f62d41f0ce0 con 0x7f62d4158900 2024-03-19T06:38:27.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.383+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62d4069be0 con 0x7f62d4158900 2024-03-19T06:38:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.402+0000 7f62d0c00640 1 -- 172.21.15.17:0/2248044927 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62bc03f070 con 0x7f62d4158900 2024-03-19T06:38:27.388 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:38:27.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 msgr2=0x7f62b006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 0x7f62b006e0e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009a10 tx=0x7f62c4008040 comp rx=0 tx=0).stop 2024-03-19T06:38:27.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 msgr2=0x7f62d41e2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f62bc02bf70 tx=0x7f62bc0046c0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 shutdown_connections 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62b006bc20 0x7f62b006e0e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d415b1d0 0x7f62d41e3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d4158900 0x7f62d41e2cd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 --2- 172.21.15.17:0/2248044927 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62d4151f70 0x7f62d41e1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 >> 172.21.15.17:0/2248044927 conn(0x7f62d40c8910 msgr2=0x7f62d4156730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 shutdown_connections 2024-03-19T06:38:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.405+0000 7f62db200640 1 -- 172.21.15.17:0/2248044927 wait complete. 2024-03-19T06:38:27.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:38:27.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.707+0000 7f7b40a00640 1 Processor -- start 2024-03-19T06:38:27.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.707+0000 7f7b40a00640 1 -- start start 2024-03-19T06:38:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.709+0000 7f7b40a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.709+0000 7f7b40a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b3c0c71a0 0x7f7b3c15d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.709+0000 7f7b40a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c15e080 con 0x7f7b3c1540b0 2024-03-19T06:38:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.709+0000 7f7b40a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c15ae10 con 0x7f7b3c0c71a0 2024-03-19T06:38:27.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.709+0000 7f7b40a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c15a980 con 0x7f7b3c06acc0 2024-03-19T06:38:27.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.711+0000 7f7b39e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:27.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.712+0000 7f7b39e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:57376/0 (socket says 172.21.15.17:57376) 2024-03-19T06:38:27.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.712+0000 7f7b39e00640 1 -- 172.21.15.17:0/2919706150 learned_addr learned my addr 172.21.15.17:0/2919706150 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:27.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.712+0000 7f7b3b200640 1 --2- 172.21.15.17:0/2919706150 >> v2:172.21.15.153:3300/0 conn(0x7f7b3c0c71a0 0x7f7b3c15d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:27.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.719+0000 7f7b39e00640 1 -- 172.21.15.17:0/2919706150 >> v2:172.21.15.153:3300/0 conn(0x7f7b3c0c71a0 msgr2=0x7f7b3c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.719+0000 7f7b39e00640 1 --2- 172.21.15.17:0/2919706150 >> v2:172.21.15.153:3300/0 conn(0x7f7b3c0c71a0 0x7f7b3c15d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.719+0000 7f7b39e00640 1 -- 172.21.15.17:0/2919706150 >> v1:172.21.15.153:6789/0 conn(0x7f7b3c1540b0 legacy=0x7f7b3c06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.719+0000 7f7b39e00640 1 -- 172.21.15.17:0/2919706150 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c15a050 con 0x7f7b3c06acc0 2024-03-19T06:38:27.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.726+0000 7f7b39e00640 1 --2- 172.21.15.17:0/2919706150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009e50 tx=0x7f7b2402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81de5719d0d98aa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:27.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.843+0000 7f7b39400640 1 -- 172.21.15.17:0/2919706150 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2402cb90 con 0x7f7b3c06acc0 2024-03-19T06:38:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.843+0000 7f7b39400640 1 -- 172.21.15.17:0/2919706150 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2402cd30 con 0x7f7b3c06acc0 2024-03-19T06:38:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.843+0000 7f7b39400640 1 -- 172.21.15.17:0/2919706150 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24034610 con 0x7f7b3c06acc0 2024-03-19T06:38:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.844+0000 7f7b40a00640 1 -- 172.21.15.17:0/2919706150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 msgr2=0x7f7b3c0c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.844+0000 7f7b40a00640 1 --2- 172.21.15.17:0/2919706150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009e50 tx=0x7f7b2402bff0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 -- 172.21.15.17:0/2919706150 shutdown_connections 2024-03-19T06:38:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 --2- 172.21.15.17:0/2919706150 >> v2:172.21.15.153:3300/0 conn(0x7f7b3c0c71a0 0x7f7b3c15d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 --2- 172.21.15.17:0/2919706150 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c06acc0 0x7f7b3c0c6c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 -- 172.21.15.17:0/2919706150 >> 172.21.15.17:0/2919706150 conn(0x7f7b3c06f750 msgr2=0x7f7b3c06fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 -- 172.21.15.17:0/2919706150 shutdown_connections 2024-03-19T06:38:27.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.845+0000 7f7b40a00640 1 -- 172.21.15.17:0/2919706150 wait complete. 2024-03-19T06:38:27.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.849+0000 7f7b40a00640 1 Processor -- start 2024-03-19T06:38:27.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.850+0000 7f7b40a00640 1 -- start start 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.852+0000 7f7b40a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b3c06acc0 0x7f7b3c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.853+0000 7f7b40a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c0c71a0 0x7f7b3c1f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.853+0000 7f7b40a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.853+0000 7f7b40a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c06bcb0 con 0x7f7b3c1540b0 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.853+0000 7f7b40a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c15a610 con 0x7f7b3c06acc0 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.853+0000 7f7b40a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0c9200 con 0x7f7b3c0c71a0 2024-03-19T06:38:27.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.854+0000 7f7b3b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:27.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.854+0000 7f7b3b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35722/0 (socket says 172.21.15.17:35722) 2024-03-19T06:38:27.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.854+0000 7f7b3b200640 1 -- 172.21.15.17:0/411749129 learned_addr learned my addr 172.21.15.17:0/411749129 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:27.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.855+0000 7f7b39e00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c0c71a0 0x7f7b3c1f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:27.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.858+0000 7f7b3b200640 1 -- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c0c71a0 msgr2=0x7f7b3c1f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.858+0000 7f7b3b200640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c0c71a0 0x7f7b3c1f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.858+0000 7f7b3b200640 1 -- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b3c06acc0 msgr2=0x7f7b3c15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:27.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.858+0000 7f7b3b200640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b3c06acc0 0x7f7b3c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:27.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.858+0000 7f7b3b200640 1 -- 172.21.15.17:0/411749129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c154a50 con 0x7f7b3c1540b0 2024-03-19T06:38:27.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.861+0000 7f7b3b200640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e960 tx=0x7f7b3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.867+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34017070 con 0x7f7b3c1540b0 2024-03-19T06:38:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.867+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3400c980 con 0x7f7b3c1540b0 2024-03-19T06:38:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.867+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400cd70 con 0x7f7b3c1540b0 2024-03-19T06:38:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.867+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c1efa10 con 0x7f7b3c1540b0 2024-03-19T06:38:27.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.867+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c0c9450 con 0x7f7b3c1540b0 2024-03-19T06:38:27.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:27.869+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c04f050 con 0x7f7b3c1540b0 2024-03-19T06:38:28.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.183+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7b3401a070 con 0x7f7b3c1540b0 2024-03-19T06:38:28.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.185+0000 7f7b32a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 0x7f7b1806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.186+0000 7f7b3a800640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 0x7f7b1806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:28.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.188+0000 7f7b3a800640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 0x7f7b1806e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c0079d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:28.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.221+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7b34057720 con 0x7f7b3c1540b0 2024-03-19T06:38:28.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.226+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f7b34059680 con 0x7f7b3c1540b0 2024-03-19T06:38:28.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.452+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b3c0c78e0 con 0x7f7b3c1540b0 2024-03-19T06:38:28.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.468+0000 7f7b32a00640 1 -- 172.21.15.17:0/411749129 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b3405d720 con 0x7f7b3c1540b0 2024-03-19T06:38:28.453 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.471+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 msgr2=0x7f7b1806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.471+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 0x7f7b1806e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c000f60 tx=0x7f7b2c0079d0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.471+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 msgr2=0x7f7b3c152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.471+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e960 tx=0x7f7b3400ee20 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 shutdown_connections 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7b3c1540b0 0x7f7b3c152690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7b3c0c71a0 0x7f7b3c1f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7b1806bc00 0x7f7b1806e0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 --2- 172.21.15.17:0/411749129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b3c06acc0 0x7f7b3c15c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 >> 172.21.15.17:0/411749129 conn(0x7f7b3c06f750 msgr2=0x7f7b3c0cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:28.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 shutdown_connections 2024-03-19T06:38:28.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.472+0000 7f7b40a00640 1 -- 172.21.15.17:0/411749129 wait complete. 2024-03-19T06:38:28.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:38:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.715+0000 7fde0e600640 1 Processor -- start 2024-03-19T06:38:28.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.715+0000 7fde0e600640 1 -- start start 2024-03-19T06:38:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.717+0000 7fde0e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 0x7fde080ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.717+0000 7fde0e600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080c7d90 con 0x7fde080c8e20 2024-03-19T06:38:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.717+0000 7fde0e600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080c8070 con 0x7fde08152110 2024-03-19T06:38:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.717+0000 7fde0e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080c8350 con 0x7fde08151d30 2024-03-19T06:38:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.719+0000 7fde07e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fde08152110 0x7fde080707c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:53952/0 (socket says 172.21.15.17:53952) 2024-03-19T06:38:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.719+0000 7fde07e00640 1 -- 172.21.15.17:0/3588649090 learned_addr learned my addr 172.21.15.17:0/3588649090 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:28.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.719+0000 7fde0d200640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 0x7fde080ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.724+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091555521 0 0) 0x7fde080c7d90 con 0x7fde080c8e20 2024-03-19T06:38:28.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.725+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003520 con 0x7fde080c8e20 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2915592113 0 0) 0x7fddf0003520 con 0x7fde080c8e20 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 msgr2=0x7fde080ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 0x7fde080ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 >> v1:172.21.15.153:6789/0 conn(0x7fde08152110 legacy=0x7fde080707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080c8630 con 0x7fde080c8e20 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fde000019f0 con 0x7fde080c8e20 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.728+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 >> v1:172.21.15.17:6789/0 conn(0x7fde080c8e20 legacy=0x7fde080c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf00039e0 0x7fddf0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0004800 0x7fddf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 0x7fddf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080c8350 con 0x7fddf0004800 2024-03-19T06:38:28.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000baa0 con 0x7fddf00039e0 2024-03-19T06:38:28.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.729+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bca0 con 0x7fde08151d30 2024-03-19T06:38:28.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.731+0000 7fde07e00640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0004800 0x7fddf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.735+0000 7fde07e00640 1 -- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 msgr2=0x7fddf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.735+0000 7fde07e00640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08151d30 0x7fddf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.735+0000 7fde07e00640 1 -- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf00039e0 msgr2=0x7fddf0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.735+0000 7fde07e00640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf00039e0 0x7fddf0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.735+0000 7fde07e00640 1 -- 172.21.15.17:0/3588649090 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003520 con 0x7fddf0004800 2024-03-19T06:38:28.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.739+0000 7fde07e00640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0004800 0x7fddf0004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007fd0 tx=0x7fddf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc3c06b3210137d server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:28.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.746+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4001460 con 0x7fddf0004800 2024-03-19T06:38:28.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.746+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4004aa0 con 0x7fddf0004800 2024-03-19T06:38:28.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.746+0000 7fde07400640 1 -- 172.21.15.17:0/3588649090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4004e50 con 0x7fddf0004800 2024-03-19T06:38:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 -- 172.21.15.17:0/3588649090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0004800 msgr2=0x7fddf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 --2- 172.21.15.17:0/3588649090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0004800 0x7fddf0004c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fddf4007fd0 tx=0x7fddf0005830 comp rx=0 tx=0).stop 2024-03-19T06:38:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0dc00640 1 -- 172.21.15.17:0/3588649090 reap_dead start 2024-03-19T06:38:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 -- 172.21.15.17:0/3588649090 shutdown_connections 2024-03-19T06:38:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 -- 172.21.15.17:0/3588649090 >> 172.21.15.17:0/3588649090 conn(0x7fde0806ac30 msgr2=0x7fde0806b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 -- 172.21.15.17:0/3588649090 shutdown_connections 2024-03-19T06:38:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.747+0000 7fde0e600640 1 -- 172.21.15.17:0/3588649090 wait complete. 2024-03-19T06:38:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.749+0000 7fde0e600640 1 Processor -- start 2024-03-19T06:38:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.749+0000 7fde0e600640 1 -- start start 2024-03-19T06:38:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde080cdc80 0x7fde080cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08154870 0x7fde08154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08071050 con 0x7fde080cdc80 2024-03-19T06:38:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08070ed0 con 0x7fddf0004800 2024-03-19T06:38:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.750+0000 7fde0e600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080c9a80 con 0x7fde08154870 2024-03-19T06:38:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.752+0000 7fde0d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.753+0000 7fde0dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08154870 0x7fde08154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.753+0000 7fde0d200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46864/0 (socket says 172.21.15.17:46864) 2024-03-19T06:38:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.753+0000 7fde0d200640 1 -- 172.21.15.17:0/1203198496 learned_addr learned my addr 172.21.15.17:0/1203198496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.763+0000 7fde0d200640 1 -- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08154870 msgr2=0x7fde08154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.763+0000 7fde0d200640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08154870 0x7fde08154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.763+0000 7fde0d200640 1 -- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde080cdc80 msgr2=0x7fde080cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.763+0000 7fde0d200640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde080cdc80 0x7fde080cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:28.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.763+0000 7fde0d200640 1 -- 172.21.15.17:0/1203198496 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde081f03e0 con 0x7fddf0004800 2024-03-19T06:38:28.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.770+0000 7fde0d200640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00e930 tx=0x7fddfc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.781+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc017070 con 0x7fddf0004800 2024-03-19T06:38:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.781+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00c940 con 0x7fddf0004800 2024-03-19T06:38:28.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.781+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde081577c0 con 0x7fddf0004800 2024-03-19T06:38:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.781+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00cd50 con 0x7fddf0004800 2024-03-19T06:38:28.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.781+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde08157d80 con 0x7fddf0004800 2024-03-19T06:38:28.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:28.784+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0804f050 con 0x7fddf0004800 2024-03-19T06:38:29.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.138+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fddfc01a070 con 0x7fddf0004800 2024-03-19T06:38:29.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.140+0000 7fde04c00640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 0x7fdde806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.141+0000 7fde07e00640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 0x7fdde806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.142+0000 7fde07e00640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 0x7fdde806e110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fddf00057e0 tx=0x7fddf4007000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:29.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.145+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fddfc057680 con 0x7fddf0004800 2024-03-19T06:38:29.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.176+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fddfc0595e0 con 0x7fddf0004800 2024-03-19T06:38:29.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.406+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fde0814ede0 con 0x7fddf0004800 2024-03-19T06:38:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.416+0000 7fde04c00640 1 -- 172.21.15.17:0/1203198496 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fddfc05d680 con 0x7fddf0004800 2024-03-19T06:38:29.401 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:38:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 msgr2=0x7fdde806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 0x7fdde806e110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fddf00057e0 tx=0x7fddf4007000 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 msgr2=0x7fde0815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00e930 tx=0x7fddfc00edf0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 shutdown_connections 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fde08154870 0x7fde08154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde080cdc80 0x7fde080cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fdde806bc50 0x7fdde806e110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 --2- 172.21.15.17:0/1203198496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddf0004800 0x7fde0815b180 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.419+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 >> 172.21.15.17:0/1203198496 conn(0x7fde0806ac30 msgr2=0x7fde0814cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.420+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 shutdown_connections 2024-03-19T06:38:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.420+0000 7fde0e600640 1 -- 172.21.15.17:0/1203198496 wait complete. 2024-03-19T06:38:29.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:38:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.653+0000 7f1500400640 1 Processor -- start 2024-03-19T06:38:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.654+0000 7f1500400640 1 -- start start 2024-03-19T06:38:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.655+0000 7f1500400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14f80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.655+0000 7f1500400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f80c27c0 con 0x7f14f80c1e60 2024-03-19T06:38:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.655+0000 7f1500400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f8157be0 con 0x7f14f8151f70 2024-03-19T06:38:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.655+0000 7f1500400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8157f30 con 0x7f14f815b1d0 2024-03-19T06:38:29.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.656+0000 7f14fe400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f14f80c1e60 0x7f14f806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39352/0 (socket says 172.21.15.17:39352) 2024-03-19T06:38:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.656+0000 7f14fe400640 1 -- 172.21.15.17:0/1287891822 learned_addr learned my addr 172.21.15.17:0/1287891822 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.657+0000 7f14fd000640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14f80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.659+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821649501 0 0) 0x7f14f80c27c0 con 0x7f14f80c1e60 2024-03-19T06:38:29.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.659+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e0003520 con 0x7f14f80c1e60 2024-03-19T06:38:29.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.663+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996514293 0 0) 0x7f14f8157be0 con 0x7f14f8151f70 2024-03-19T06:38:29.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.663+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f80c27c0 con 0x7f14f8151f70 2024-03-19T06:38:29.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639899311 0 0) 0x7f14e0003520 con 0x7f14f80c1e60 2024-03-19T06:38:29.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 msgr2=0x7f14f80c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:29.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14f80c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 >> v1:172.21.15.153:6789/0 conn(0x7f14f8151f70 legacy=0x7f14f81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f815b730 con 0x7f14f80c1e60 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f14f00019f0 con 0x7f14f80c1e60 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 >> v1:172.21.15.17:6789/0 conn(0x7f14f80c1e60 legacy=0x7f14f806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14e0003b70 0x7f14e0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14e0004800 0x7f14e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8157f30 con 0x7f14e0004800 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e000ba70 con 0x7f14e0003b70 2024-03-19T06:38:29.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.664+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e000bc70 con 0x7f14f815b1d0 2024-03-19T06:38:29.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.671+0000 7f14fe400640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.677+0000 7f14fda00640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14e0003b70 0x7f14e0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.679+0000 7f14fe400640 1 -- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14e0003b70 msgr2=0x7f14e0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.679+0000 7f14fe400640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14e0003b70 0x7f14e0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.679+0000 7f14fe400640 1 -- 172.21.15.17:0/1287891822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14e0004800 msgr2=0x7f14e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.679+0000 7f14fe400640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14e0004800 0x7f14e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.679+0000 7f14fe400640 1 -- 172.21.15.17:0/1287891822 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0003520 con 0x7f14f815b1d0 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.685+0000 7f14fe400640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14e00051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a760 tx=0x7f14e0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6df6fd1eaced7f5b server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.695+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000a3b0 con 0x7f14f815b1d0 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.695+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f0034630 con 0x7f14f815b1d0 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.695+0000 7f14f7e00640 1 -- 172.21.15.17:0/1287891822 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0034ae0 con 0x7f14f815b1d0 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 -- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 msgr2=0x7f14e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 --2- 172.21.15.17:0/1287891822 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f815b1d0 0x7f14e00051c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f14f000a760 tx=0x7f14e0005830 comp rx=0 tx=0).stop 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f14fe400640 1 -- 172.21.15.17:0/1287891822 reap_dead start 2024-03-19T06:38:29.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 -- 172.21.15.17:0/1287891822 shutdown_connections 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 -- 172.21.15.17:0/1287891822 >> 172.21.15.17:0/1287891822 conn(0x7f14f80c8910 msgr2=0x7f14f80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 -- 172.21.15.17:0/1287891822 shutdown_connections 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.697+0000 7f1500400640 1 -- 172.21.15.17:0/1287891822 wait complete. 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.701+0000 7f1500400640 1 Processor -- start 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.701+0000 7f1500400640 1 -- start start 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f80c3440 0x7f14f81567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 0x7f14f8142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f815bcf0 con 0x7f14f81f04d0 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f8152350 con 0x7f14f80c3820 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.703+0000 7f1500400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f815bfd0 con 0x7f14f80c3440 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.705+0000 7f14fda00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f80c3440 0x7f14f81567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.705+0000 7f14fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.706+0000 7f14fd000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46880/0 (socket says 172.21.15.17:46880) 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.706+0000 7f14fd000640 1 -- 172.21.15.17:0/1151446102 learned_addr learned my addr 172.21.15.17:0/1151446102 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.713+0000 7f14fe400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 0x7f14f8142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fd000640 1 -- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f80c3440 msgr2=0x7f14f81567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fd000640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f80c3440 0x7f14f81567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fd000640 1 -- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 msgr2=0x7f14f8142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fd000640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 0x7f14f8142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fd000640 1 -- 172.21.15.17:0/1151446102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8149450 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.716+0000 7f14fe400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 0x7f14f8142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.723+0000 7f14fd000640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00e7f0 tx=0x7f14ec00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.732+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec017070 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.733+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00ee40 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.733+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00cb00 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.733+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f81f4920 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.733+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81f3be0 con 0x7f14f80c3820 2024-03-19T06:38:29.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:29.735+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f8149c40 con 0x7f14f80c3820 2024-03-19T06:38:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.089+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f14ec01a070 con 0x7f14f80c3820 2024-03-19T06:38:30.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.092+0000 7f14f5600640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 0x7f14dc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:30.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.093+0000 7f14fda00640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 0x7f14dc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.095+0000 7f14fda00640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 0x7f14dc06e110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14e80018d0 tx=0x7f14e8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:30.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.096+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f14ec0574a0 con 0x7f14f80c3820 2024-03-19T06:38:30.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.167+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f14f8149c40 con 0x7f14f80c3820 2024-03-19T06:38:30.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.475+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f14f8069be0 con 0x7f14f80c3820 2024-03-19T06:38:30.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.688+0000 7f14f5600640 1 -- 172.21.15.17:0/1151446102 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f14ec059b00 con 0x7f14f80c3820 2024-03-19T06:38:30.674 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 msgr2=0x7f14dc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 0x7f14dc06e110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14e80018d0 tx=0x7f14e8009040 comp rx=0 tx=0).stop 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 msgr2=0x7f14f81f43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00e7f0 tx=0x7f14ec00ebf0 comp rx=0 tx=0).stop 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 shutdown_connections 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14f81f04d0 0x7f14f8142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f14dc06bc50 0x7f14dc06e110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14f80c3820 0x7f14f81f43e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:30.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 --2- 172.21.15.17:0/1151446102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f14f80c3440 0x7f14f81567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 >> 172.21.15.17:0/1151446102 conn(0x7f14f80c8910 msgr2=0x7f14f80c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.692+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 shutdown_connections 2024-03-19T06:38:30.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:30.693+0000 7f1500400640 1 -- 172.21.15.17:0/1151446102 wait complete. 2024-03-19T06:38:30.701 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-19T06:38:30.701 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-19T06:38:30.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:38:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.031+0000 7f4c35800640 1 Processor -- start 2024-03-19T06:38:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.031+0000 7f4c35800640 1 -- start start 2024-03-19T06:38:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.033+0000 7f4c35800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c300c8df0 0x7f4c30071fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.033+0000 7f4c35800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c30072520 0x7f4c3015a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.033+0000 7f4c35800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300c77e0 con 0x7f4c300c91d0 2024-03-19T06:38:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.033+0000 7f4c35800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300c97d0 con 0x7f4c300c8df0 2024-03-19T06:38:31.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.033+0000 7f4c35800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300c7ac0 con 0x7f4c30072520 2024-03-19T06:38:31.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.034+0000 7f4c2ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c300c8df0 0x7f4c30071fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.035+0000 7f4c2ea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4c300c8df0 0x7f4c30071fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48468/0 (socket says 172.21.15.17:48468) 2024-03-19T06:38:31.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.035+0000 7f4c2ea00640 1 -- 172.21.15.17:0/1433979788 learned_addr learned my addr 172.21.15.17:0/1433979788 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:31.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.038+0000 7f4c2e000640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c30072520 0x7f4c3015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.041+0000 7f4c2ea00640 1 -- 172.21.15.17:0/1433979788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c30072520 msgr2=0x7f4c3015a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.041+0000 7f4c2ea00640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c30072520 0x7f4c3015a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.041+0000 7f4c2ea00640 1 -- 172.21.15.17:0/1433979788 >> v1:172.21.15.17:6789/0 conn(0x7f4c300c91d0 legacy=0x7f4c30153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.041+0000 7f4c2ea00640 1 -- 172.21.15.17:0/1433979788 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300c7da0 con 0x7f4c300c8df0 2024-03-19T06:38:31.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.047+0000 7f4c2ea00640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c8df0 0x7f4c30071fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009e50 tx=0x7f4c2002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d917d1fdf3ac84 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.055+0000 7f4c2d600640 1 -- 172.21.15.17:0/1433979788 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2002cb90 con 0x7f4c300c8df0 2024-03-19T06:38:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.055+0000 7f4c2d600640 1 -- 172.21.15.17:0/1433979788 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2002cd30 con 0x7f4c300c8df0 2024-03-19T06:38:31.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.055+0000 7f4c2d600640 1 -- 172.21.15.17:0/1433979788 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20034610 con 0x7f4c300c8df0 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 -- 172.21.15.17:0/1433979788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c8df0 msgr2=0x7f4c30071fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c8df0 0x7f4c30071fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4c20009e50 tx=0x7f4c2002bff0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 -- 172.21.15.17:0/1433979788 shutdown_connections 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c30072520 0x7f4c3015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 --2- 172.21.15.17:0/1433979788 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c8df0 0x7f4c30071fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 -- 172.21.15.17:0/1433979788 >> 172.21.15.17:0/1433979788 conn(0x7f4c300670b0 msgr2=0x7f4c300cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 -- 172.21.15.17:0/1433979788 shutdown_connections 2024-03-19T06:38:31.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.056+0000 7f4c35800640 1 -- 172.21.15.17:0/1433979788 wait complete. 2024-03-19T06:38:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.058+0000 7f4c35800640 1 Processor -- start 2024-03-19T06:38:31.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.059+0000 7f4c35800640 1 -- start start 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c300c8df0 0x7f4c300c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c30149ea0 0x7f4c30143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300c8640 con 0x7f4c300c91d0 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300c8360 con 0x7f4c30149ea0 2024-03-19T06:38:31.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.060+0000 7f4c35800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c301542e0 con 0x7f4c300c8df0 2024-03-19T06:38:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.061+0000 7f4c2e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.061+0000 7f4c2e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48474/0 (socket says 172.21.15.17:48474) 2024-03-19T06:38:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.061+0000 7f4c2e000640 1 -- 172.21.15.17:0/2785733991 learned_addr learned my addr 172.21.15.17:0/2785733991 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:31.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.062+0000 7f4c2f400640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c30149ea0 0x7f4c30143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.062+0000 7f4c2ea00640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c300c8df0 0x7f4c300c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.066+0000 7f4c2e000640 1 -- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c300c8df0 msgr2=0x7f4c300c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.066+0000 7f4c2e000640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c300c8df0 0x7f4c300c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.066+0000 7f4c2e000640 1 -- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c30149ea0 msgr2=0x7f4c30143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.066+0000 7f4c2e000640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c30149ea0 0x7f4c30143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.066+0000 7f4c2e000640 1 -- 172.21.15.17:0/2785733991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300cc3a0 con 0x7f4c300c91d0 2024-03-19T06:38:31.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.069+0000 7f4c2e000640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800d830 tx=0x7f4c1800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.074+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800b6c0 con 0x7f4c300c91d0 2024-03-19T06:38:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.074+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18019070 con 0x7f4c300c91d0 2024-03-19T06:38:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.074+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800ba80 con 0x7f4c300c91d0 2024-03-19T06:38:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.074+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c300cab20 con 0x7f4c300c91d0 2024-03-19T06:38:31.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.074+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c300cade0 con 0x7f4c300c91d0 2024-03-19T06:38:31.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.076+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3015ad30 con 0x7f4c300c91d0 2024-03-19T06:38:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.400+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f4c1801e460 con 0x7f4c300c91d0 2024-03-19T06:38:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.404+0000 7f4c26a00640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 0x7f4c0c06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.404+0000 7f4c2ea00640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 0x7f4c0c06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:31.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.406+0000 7f4c2ea00640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 0x7f4c0c06e110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c20035000 tx=0x7f4c20030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:31.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.445+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4c18057fd0 con 0x7f4c300c91d0 2024-03-19T06:38:31.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.446+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f4c3015ad30 con 0x7f4c300c91d0 2024-03-19T06:38:31.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.679+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c30069be0 con 0x7f4c300c91d0 2024-03-19T06:38:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.793+0000 7f4c26a00640 1 -- 172.21.15.17:0/2785733991 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f4c1805c090 con 0x7f4c300c91d0 2024-03-19T06:38:31.779 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:31.779 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:38:31.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.796+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 msgr2=0x7f4c0c06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.796+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 0x7f4c0c06e110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c20035000 tx=0x7f4c20030000 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.796+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 msgr2=0x7f4c301ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.796+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800d830 tx=0x7f4c1800dcf0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 shutdown_connections 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f4c0c06bc50 0x7f4c0c06e110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c30149ea0 0x7f4c30143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c300c91d0 0x7f4c301ef9a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 --2- 172.21.15.17:0/2785733991 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f4c300c8df0 0x7f4c300c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 >> 172.21.15.17:0/2785733991 conn(0x7f4c300670b0 msgr2=0x7f4c3015a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 shutdown_connections 2024-03-19T06:38:31.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:31.797+0000 7f4c35800640 1 -- 172.21.15.17:0/2785733991 wait complete. 2024-03-19T06:38:31.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-19T06:06:07.816327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-19T06:06:30.394430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-19T06:06:32.423654+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-19T06:06:39.891065+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-19T06:38:31.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-19T06:38:32.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.042+0000 7fb04ee00640 1 Processor -- start 2024-03-19T06:38:32.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.042+0000 7fb04ee00640 1 -- start start 2024-03-19T06:38:32.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.044+0000 7fb04ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb0480c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.044+0000 7fb04ee00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480c27c0 con 0x7fb0480c1e60 2024-03-19T06:38:32.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.044+0000 7fb04ee00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb048157be0 con 0x7fb048151f70 2024-03-19T06:38:32.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.044+0000 7fb04ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb048157f30 con 0x7fb04815b1d0 2024-03-19T06:38:32.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.046+0000 7fb047e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb048151f70 0x7fb0481583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:53962/0 (socket says 172.21.15.17:53962) 2024-03-19T06:38:32.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.046+0000 7fb047e00640 1 -- 172.21.15.17:0/3958180240 learned_addr learned my addr 172.21.15.17:0/3958180240 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:32.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.053+0000 7fb047400640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb0480c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.053+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553635223 0 0) 0x7fb0480c27c0 con 0x7fb0480c1e60 2024-03-19T06:38:32.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.054+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb02c003520 con 0x7fb0480c1e60 2024-03-19T06:38:32.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.055+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874993167 0 0) 0x7fb048157be0 con 0x7fb048151f70 2024-03-19T06:38:32.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.055+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0480c27c0 con 0x7fb048151f70 2024-03-19T06:38:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232514575 0 0) 0x7fb02c003520 con 0x7fb0480c1e60 2024-03-19T06:38:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 msgr2=0x7fb0480c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:32.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb0480c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 >> v1:172.21.15.153:6789/0 conn(0x7fb048151f70 legacy=0x7fb0481583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04815b730 con 0x7fb0480c1e60 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fb0400019f0 con 0x7fb0480c1e60 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 >> v1:172.21.15.17:6789/0 conn(0x7fb0480c1e60 legacy=0x7fb04806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb02c003b70 0x7fb02c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 0x7fb02c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048157f30 con 0x7fb02c003b70 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c00fe80 con 0x7fb02c004800 2024-03-19T06:38:32.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.061+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c010080 con 0x7fb04815b1d0 2024-03-19T06:38:32.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.063+0000 7fb047e00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb02c003b70 0x7fb02c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.067+0000 7fb04ce00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb047e00640 1 -- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 msgr2=0x7fb02c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:32.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb047e00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb02c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb047e00640 1 -- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 msgr2=0x7fb02c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb047e00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb02c004800 0x7fb02c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb047e00640 1 -- 172.21.15.17:0/3958180240 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c003520 con 0x7fb02c003b70 2024-03-19T06:38:32.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.070+0000 7fb04ce00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb04815b1d0 0x7fb02c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-19T06:38:32.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.074+0000 7fb047e00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb02c003b70 0x7fb02c003f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0380019c0 tx=0x7fb02c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf46a9691338b02 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:32.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.082+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380015e0 con 0x7fb02c003b70 2024-03-19T06:38:32.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.082+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0380048a0 con 0x7fb02c003b70 2024-03-19T06:38:32.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.082+0000 7fb046a00640 1 -- 172.21.15.17:0/3958180240 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038004a90 con 0x7fb02c003b70 2024-03-19T06:38:32.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ee00640 1 -- 172.21.15.17:0/3958180240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb02c003b70 msgr2=0x7fb02c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3958180240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb02c003b70 0x7fb02c003f70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb0380019c0 tx=0x7fb02c005830 comp rx=0 tx=0).stop 2024-03-19T06:38:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ce00640 1 -- 172.21.15.17:0/3958180240 reap_dead start 2024-03-19T06:38:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ee00640 1 -- 172.21.15.17:0/3958180240 shutdown_connections 2024-03-19T06:38:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ee00640 1 -- 172.21.15.17:0/3958180240 >> 172.21.15.17:0/3958180240 conn(0x7fb0480c8910 msgr2=0x7fb0480cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.083+0000 7fb04ee00640 1 -- 172.21.15.17:0/3958180240 shutdown_connections 2024-03-19T06:38:32.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.084+0000 7fb04ee00640 1 -- 172.21.15.17:0/3958180240 wait complete. 2024-03-19T06:38:32.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.087+0000 7fb04ee00640 1 Processor -- start 2024-03-19T06:38:32.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.087+0000 7fb04ee00640 1 -- start start 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb02c003b70 0x7fb0480c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480711f0 0x7fb048071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815bcf0 con 0x7fb0481524d0 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb048152350 con 0x7fb0480711f0 2024-03-19T06:38:32.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.089+0000 7fb04ee00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815bfd0 con 0x7fb02c003b70 2024-03-19T06:38:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.090+0000 7fb047400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.091+0000 7fb047e00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb02c003b70 0x7fb0480c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.091+0000 7fb047400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48486/0 (socket says 172.21.15.17:48486) 2024-03-19T06:38:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.091+0000 7fb047400640 1 -- 172.21.15.17:0/3186758544 learned_addr learned my addr 172.21.15.17:0/3186758544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:32.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.092+0000 7fb04ce00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480711f0 0x7fb048071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.095+0000 7fb047400640 1 -- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb02c003b70 msgr2=0x7fb0480c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.095+0000 7fb047400640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb02c003b70 0x7fb0480c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.095+0000 7fb047400640 1 -- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480711f0 msgr2=0x7fb048071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.095+0000 7fb047400640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480711f0 0x7fb048071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.095+0000 7fb047400640 1 -- 172.21.15.17:0/3186758544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0481546d0 con 0x7fb0481524d0 2024-03-19T06:38:32.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.098+0000 7fb047400640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb03000e7d0 tx=0x7fb03000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.103+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030017070 con 0x7fb0481524d0 2024-03-19T06:38:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.104+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000ee80 con 0x7fb0481524d0 2024-03-19T06:38:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.104+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000cb00 con 0x7fb0481524d0 2024-03-19T06:38:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.104+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0481eb9c0 con 0x7fb0481524d0 2024-03-19T06:38:32.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.104+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0481ebf80 con 0x7fb0481524d0 2024-03-19T06:38:32.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.106+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb048069be0 con 0x7fb0481524d0 2024-03-19T06:38:32.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.143+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb03001a070 con 0x7fb0481524d0 2024-03-19T06:38:32.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.145+0000 7fb03fe00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 0x7fb02406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:32.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.146+0000 7fb047e00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 0x7fb02406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:32.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.148+0000 7fb047e00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 0x7fb02406e0e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb038034000 tx=0x7fb03802f000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.500+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb030057500 con 0x7fb0481524d0 2024-03-19T06:38:32.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.500+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb030059460 con 0x7fb0481524d0 2024-03-19T06:38:32.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.728+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0480c7200 con 0x7fb0481524d0 2024-03-19T06:38:32.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.851+0000 7fb03fe00640 1 -- 172.21.15.17:0/3186758544 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb03005d500 con 0x7fb0481524d0 2024-03-19T06:38:32.836 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-19T06:38:32.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 msgr2=0x7fb02406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 0x7fb02406e0e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb038034000 tx=0x7fb03802f000 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 msgr2=0x7fb048153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb03000e7d0 tx=0x7fb03000ec90 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 shutdown_connections 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb02406bc20 0x7fb02406e0e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0480711f0 0x7fb048071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0481524d0 0x7fb048153e00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 --2- 172.21.15.17:0/3186758544 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb02c003b70 0x7fb0480c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.854+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 >> 172.21.15.17:0/3186758544 conn(0x7fb0480c8910 msgr2=0x7fb0480c3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.855+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 shutdown_connections 2024-03-19T06:38:32.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:32.855+0000 7fb04ee00640 1 -- 172.21.15.17:0/3186758544 wait complete. 2024-03-19T06:38:32.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-19T06:38:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.106+0000 7f361ac00640 1 Processor -- start 2024-03-19T06:38:33.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.106+0000 7f361ac00640 1 -- start start 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.108+0000 7f361ac00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f36140cb8d0 0x7f36140cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.108+0000 7f361ac00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36140cb2d0 0x7f361415d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.108+0000 7f361ac00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f361415d3b0 con 0x7f36141541d0 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.108+0000 7f361ac00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36140ca9b0 con 0x7f36140cb8d0 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.108+0000 7f361ac00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f361415a0d0 con 0x7f36140cb2d0 2024-03-19T06:38:33.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.109+0000 7f3613400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f36140cb8d0 0x7f36140cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.110+0000 7f3618c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f36140cb2d0 0x7f361415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.110+0000 7f3613e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f36141541d0 0x7f36140ca2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37934/0 (socket says 172.21.15.17:37934) 2024-03-19T06:38:33.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.110+0000 7f3613e00640 1 -- 172.21.15.17:0/3869100131 learned_addr learned my addr 172.21.15.17:0/3869100131 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.115+0000 7f3613400640 1 -- 172.21.15.17:0/3869100131 >> v2:172.21.15.153:3300/0 conn(0x7f36140cb2d0 msgr2=0x7f361415d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.115+0000 7f3613400640 1 --2- 172.21.15.17:0/3869100131 >> v2:172.21.15.153:3300/0 conn(0x7f36140cb2d0 0x7f361415d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.115+0000 7f3613400640 1 -- 172.21.15.17:0/3869100131 >> v1:172.21.15.17:6789/0 conn(0x7f36141541d0 legacy=0x7f36140ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.115+0000 7f3613400640 1 -- 172.21.15.17:0/3869100131 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361415a3b0 con 0x7f36140cb8d0 2024-03-19T06:38:33.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.119+0000 7f3613400640 1 --2- 172.21.15.17:0/3869100131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f36140cad90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36140cbf40 tx=0x7f35fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca35dbfc0336d10 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:33.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.125+0000 7f3612a00640 1 -- 172.21.15.17:0/3869100131 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc034070 con 0x7f36140cb8d0 2024-03-19T06:38:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.125+0000 7f3612a00640 1 -- 172.21.15.17:0/3869100131 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc030610 con 0x7f36140cb8d0 2024-03-19T06:38:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.125+0000 7f3612a00640 1 -- 172.21.15.17:0/3869100131 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc0309e0 con 0x7f36140cb8d0 2024-03-19T06:38:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.125+0000 7f361ac00640 1 -- 172.21.15.17:0/3869100131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 msgr2=0x7f36140cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.125+0000 7f361ac00640 1 --2- 172.21.15.17:0/3869100131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f36140cad90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f36140cbf40 tx=0x7f35fc02b960 comp rx=0 tx=0).stop 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 -- 172.21.15.17:0/3869100131 shutdown_connections 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 --2- 172.21.15.17:0/3869100131 >> v2:172.21.15.153:3300/0 conn(0x7f36140cb2d0 0x7f361415d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 --2- 172.21.15.17:0/3869100131 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f36140cad90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 -- 172.21.15.17:0/3869100131 >> 172.21.15.17:0/3869100131 conn(0x7f361406baf0 msgr2=0x7f361406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 -- 172.21.15.17:0/3869100131 shutdown_connections 2024-03-19T06:38:33.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.126+0000 7f361ac00640 1 -- 172.21.15.17:0/3869100131 wait complete. 2024-03-19T06:38:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.128+0000 7f361ac00640 1 Processor -- start 2024-03-19T06:38:33.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.129+0000 7f361ac00640 1 -- start start 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36140cb2d0 0x7f361414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36141541d0 0x7f36141581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3614159da0 con 0x7f36140cb8d0 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361415a970 con 0x7f36140cb2d0 2024-03-19T06:38:33.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.130+0000 7f361ac00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361415ac50 con 0x7f36141541d0 2024-03-19T06:38:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.131+0000 7f3613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.131+0000 7f3613400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48518/0 (socket says 172.21.15.17:48518) 2024-03-19T06:38:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.131+0000 7f3613400640 1 -- 172.21.15.17:0/1717692739 learned_addr learned my addr 172.21.15.17:0/1717692739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:33.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.132+0000 7f3613e00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36140cb2d0 0x7f361414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.132+0000 7f3618c00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36141541d0 0x7f36141581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.136+0000 7f3613400640 1 -- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36141541d0 msgr2=0x7f36141581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.136+0000 7f3613400640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36141541d0 0x7f36141581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.136+0000 7f3613400640 1 -- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36140cb2d0 msgr2=0x7f361414dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.136+0000 7f3613400640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36140cb2d0 0x7f361414dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.136+0000 7f3613400640 1 -- 172.21.15.17:0/1717692739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36141f0430 con 0x7f36140cb8d0 2024-03-19T06:38:33.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.138+0000 7f3613400640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f35fc000c00 tx=0x7f35fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.143+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc034040 con 0x7f36140cb8d0 2024-03-19T06:38:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.143+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc030410 con 0x7f36140cb8d0 2024-03-19T06:38:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.143+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc039c50 con 0x7f36140cb8d0 2024-03-19T06:38:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.143+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36141f06d0 con 0x7f36140cb8d0 2024-03-19T06:38:33.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.143+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36141f0990 con 0x7f36140cb8d0 2024-03-19T06:38:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.144+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3614069be0 con 0x7f36140cb8d0 2024-03-19T06:38:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.166+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f35fc037070 con 0x7f36140cb8d0 2024-03-19T06:38:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.167+0000 7f360be00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 0x7f35f006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.167+0000 7f3613e00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 0x7f35f006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.168+0000 7f3613e00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 0x7f35f006e110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3604007fd0 tx=0x7f3604007e80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.471+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f35fc0305c0 con 0x7f36140cb8d0 2024-03-19T06:38:33.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.471+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f35fc07c070 con 0x7f36140cb8d0 2024-03-19T06:38:33.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.689+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36140cf270 con 0x7f36140cb8d0 2024-03-19T06:38:33.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.726+0000 7f360be00640 1 -- 172.21.15.17:0/1717692739 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35fc07b970 con 0x7f36140cb8d0 2024-03-19T06:38:33.712 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:38:33.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 msgr2=0x7f35f006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 0x7f35f006e110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3604007fd0 tx=0x7f3604007e80 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 msgr2=0x7f3614151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f35fc000c00 tx=0x7f35fc0046c0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 shutdown_connections 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f36141541d0 0x7f36141581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36140cb8d0 0x7f3614151bd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f35f006bc50 0x7f35f006e110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 --2- 172.21.15.17:0/1717692739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36140cb2d0 0x7f361414dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.729+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 >> 172.21.15.17:0/1717692739 conn(0x7f361406baf0 msgr2=0x7f3614073f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.730+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 shutdown_connections 2024-03-19T06:38:33.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.730+0000 7f361ac00640 1 -- 172.21.15.17:0/1717692739 wait complete. 2024-03-19T06:38:33.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-19T06:38:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.968+0000 7fda89400640 1 Processor -- start 2024-03-19T06:38:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.968+0000 7fda89400640 1 -- start start 2024-03-19T06:38:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.970+0000 7fda89400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 0x7fda8415b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.970+0000 7fda89400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8415bc70 con 0x7fda84151f00 2024-03-19T06:38:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.970+0000 7fda89400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda84157b20 con 0x7fda84072190 2024-03-19T06:38:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.970+0000 7fda89400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda84157de0 con 0x7fda8415b2a0 2024-03-19T06:38:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.972+0000 7fda7be00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fda84072190 0x7fda8406ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:53974/0 (socket says 172.21.15.17:53974) 2024-03-19T06:38:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.972+0000 7fda7be00640 1 -- 172.21.15.17:0/2037673580 learned_addr learned my addr 172.21.15.17:0/2037673580 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:33.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.973+0000 7fda88a00640 1 --2- 172.21.15.17:0/2037673580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 0x7fda8415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.980+0000 7fda88a00640 1 -- 172.21.15.17:0/2037673580 >> v1:172.21.15.153:6789/0 conn(0x7fda84072190 legacy=0x7fda8406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.980+0000 7fda88a00640 1 -- 172.21.15.17:0/2037673580 >> v1:172.21.15.17:6789/0 conn(0x7fda84151f00 legacy=0x7fda840c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:33.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.980+0000 7fda88a00640 1 -- 172.21.15.17:0/2037673580 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda841580c0 con 0x7fda8415b2a0 2024-03-19T06:38:33.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.987+0000 7fda88a00640 1 --2- 172.21.15.17:0/2037673580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 0x7fda8415b730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009dc0 tx=0x7fda7c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf2c3b08e50a34f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:33.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.999+0000 7fda83400640 1 -- 172.21.15.17:0/2037673580 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c039070 con 0x7fda8415b2a0 2024-03-19T06:38:33.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.999+0000 7fda83400640 1 -- 172.21.15.17:0/2037673580 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c02cc40 con 0x7fda8415b2a0 2024-03-19T06:38:33.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:33.999+0000 7fda83400640 1 -- 172.21.15.17:0/2037673580 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c034440 con 0x7fda8415b2a0 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.000+0000 7fda89400640 1 -- 172.21.15.17:0/2037673580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 msgr2=0x7fda8415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.000+0000 7fda89400640 1 --2- 172.21.15.17:0/2037673580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 0x7fda8415b730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009dc0 tx=0x7fda7c02be90 comp rx=0 tx=0).stop 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.000+0000 7fda89400640 1 -- 172.21.15.17:0/2037673580 shutdown_connections 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.000+0000 7fda89400640 1 --2- 172.21.15.17:0/2037673580 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda8415b2a0 0x7fda8415b730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.000+0000 7fda89400640 1 -- 172.21.15.17:0/2037673580 >> 172.21.15.17:0/2037673580 conn(0x7fda840cc260 msgr2=0x7fda840cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.001+0000 7fda89400640 1 -- 172.21.15.17:0/2037673580 shutdown_connections 2024-03-19T06:38:33.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.001+0000 7fda89400640 1 -- 172.21.15.17:0/2037673580 wait complete. 2024-03-19T06:38:33.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.003+0000 7fda89400640 1 Processor -- start 2024-03-19T06:38:33.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.003+0000 7fda89400640 1 -- start start 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda84072190 0x7fda84154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda84151f00 0x7fda84150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda84072f10 con 0x7fda8415b2a0 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda84158680 con 0x7fda84072190 2024-03-19T06:38:33.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.004+0000 7fda89400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8414c970 con 0x7fda84151f00 2024-03-19T06:38:33.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.005+0000 7fda88a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.005+0000 7fda88a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48526/0 (socket says 172.21.15.17:48526) 2024-03-19T06:38:33.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.005+0000 7fda88a00640 1 -- 172.21.15.17:0/1358387080 learned_addr learned my addr 172.21.15.17:0/1358387080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:33.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.006+0000 7fda83e00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda84072190 0x7fda84154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.007+0000 7fda7be00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda84151f00 0x7fda84150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.010+0000 7fda88a00640 1 -- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda84151f00 msgr2=0x7fda84150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.010+0000 7fda88a00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda84151f00 0x7fda84150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.010+0000 7fda88a00640 1 -- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda84072190 msgr2=0x7fda84154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.010+0000 7fda88a00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda84072190 0x7fda84154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:33.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.010+0000 7fda88a00640 1 -- 172.21.15.17:0/1358387080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84151150 con 0x7fda8415b2a0 2024-03-19T06:38:33.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.013+0000 7fda88a00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda7c02c4a0 tx=0x7fda7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:34.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.020+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c044020 con 0x7fda8415b2a0 2024-03-19T06:38:34.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.020+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c03a040 con 0x7fda8415b2a0 2024-03-19T06:38:34.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.020+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c039070 con 0x7fda8415b2a0 2024-03-19T06:38:34.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.020+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda841f2d60 con 0x7fda8415b2a0 2024-03-19T06:38:34.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.020+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8414cc10 con 0x7fda8415b2a0 2024-03-19T06:38:34.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.021+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8404f050 con 0x7fda8415b2a0 2024-03-19T06:38:34.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.356+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fda7c047020 con 0x7fda8415b2a0 2024-03-19T06:38:34.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.358+0000 7fda80c00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 0x7fda6006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.359+0000 7fda83e00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 0x7fda6006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:34.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.362+0000 7fda83e00640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 0x7fda6006e110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda740017f0 tx=0x7fda74009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:34.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.394+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fda7c079fe0 con 0x7fda8415b2a0 2024-03-19T06:38:34.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.398+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fda7c04e020 con 0x7fda8415b2a0 2024-03-19T06:38:34.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.623+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda8415beb0 con 0x7fda8415b2a0 2024-03-19T06:38:34.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.638+0000 7fda80c00640 1 -- 172.21.15.17:0/1358387080 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda7c07c640 con 0x7fda8415b2a0 2024-03-19T06:38:34.623 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 msgr2=0x7fda6006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 0x7fda6006e110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fda740017f0 tx=0x7fda74009040 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 msgr2=0x7fda840c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fda7c02c4a0 tx=0x7fda7c004a40 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 shutdown_connections 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda8415b2a0 0x7fda840c8020 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fda84151f00 0x7fda84150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda6006bc50 0x7fda6006e110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 --2- 172.21.15.17:0/1358387080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda84072190 0x7fda84154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.641+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 >> 172.21.15.17:0/1358387080 conn(0x7fda840cc260 msgr2=0x7fda840c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.642+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 shutdown_connections 2024-03-19T06:38:34.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.642+0000 7fda89400640 1 -- 172.21.15.17:0/1358387080 wait complete. 2024-03-19T06:38:34.647 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-19T06:38:34.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.867+0000 7fad4d000640 1 Processor -- start 2024-03-19T06:38:34.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.867+0000 7fad4d000640 1 -- start start 2024-03-19T06:38:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.869+0000 7fad4d000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad4806cf30 0x7fad4815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.869+0000 7fad4d000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad48154150 con 0x7fad4815d840 2024-03-19T06:38:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.869+0000 7fad4d000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4815ac10 con 0x7fad48153d70 2024-03-19T06:38:34.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.869+0000 7fad4d000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4815e1f0 con 0x7fad4806cf30 2024-03-19T06:38:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.874+0000 7fad45e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fad48153d70 0x7fad480c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:53984/0 (socket says 172.21.15.17:53984) 2024-03-19T06:38:34.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.874+0000 7fad45e00640 1 -- 172.21.15.17:0/1992368962 learned_addr learned my addr 172.21.15.17:0/1992368962 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.878+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111099057 0 0) 0x7fad48154150 con 0x7fad4815d840 2024-03-19T06:38:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.878+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad2c003520 con 0x7fad4815d840 2024-03-19T06:38:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad46800640 1 --2- 172.21.15.17:0/1992368962 >> v2:172.21.15.153:3300/0 conn(0x7fad4806cf30 0x7fad4815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138540264 0 0) 0x7fad2c003520 con 0x7fad4815d840 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 >> v2:172.21.15.153:3300/0 conn(0x7fad4806cf30 msgr2=0x7fad4815dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 --2- 172.21.15.17:0/1992368962 >> v2:172.21.15.153:3300/0 conn(0x7fad4806cf30 0x7fad4815dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 >> v1:172.21.15.153:6789/0 conn(0x7fad48153d70 legacy=0x7fad480c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4815a090 con 0x7fad4815d840 2024-03-19T06:38:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fad300016e0 con 0x7fad4815d840 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 >> v1:172.21.15.17:6789/0 conn(0x7fad4815d840 legacy=0x7fad4806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 0x7fad2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c004800 0x7fad2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.882+0000 7fad45400640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c0052e0 0x7fad2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.883+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815e1f0 con 0x7fad2c003a00 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.883+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c00c220 con 0x7fad2c0052e0 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.883+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c00c420 con 0x7fad2c004800 2024-03-19T06:38:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.884+0000 7fad45e00640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 0x7fad2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad45e00640 1 -- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c004800 msgr2=0x7fad2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad45e00640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c004800 0x7fad2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad45e00640 1 -- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c0052e0 msgr2=0x7fad2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad45e00640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c0052e0 0x7fad2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad45e00640 1 -- 172.21.15.17:0/1992368962 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c003520 con 0x7fad2c003a00 2024-03-19T06:38:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.891+0000 7fad46800640 1 -- 172.21.15.17:0/1992368962 reap_dead start 2024-03-19T06:38:34.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.894+0000 7fad45e00640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 0x7fad2c003e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad38005100 tx=0x7fad2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafcb8823f7b9ec0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.898+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38004d00 con 0x7fad2c003a00 2024-03-19T06:38:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.898+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38005af0 con 0x7fad2c003a00 2024-03-19T06:38:34.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.898+0000 7fad45400640 1 -- 172.21.15.17:0/1992368962 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38007070 con 0x7fad2c003a00 2024-03-19T06:38:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.899+0000 7fad4d000640 1 -- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 msgr2=0x7fad2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.899+0000 7fad4d000640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 0x7fad2c003e00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fad38005100 tx=0x7fad2c005830 comp rx=0 tx=0).stop 2024-03-19T06:38:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.900+0000 7fad4d000640 1 -- 172.21.15.17:0/1992368962 shutdown_connections 2024-03-19T06:38:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.900+0000 7fad4d000640 1 --2- 172.21.15.17:0/1992368962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad2c003a00 0x7fad2c003e00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.900+0000 7fad4d000640 1 -- 172.21.15.17:0/1992368962 >> 172.21.15.17:0/1992368962 conn(0x7fad48066e10 msgr2=0x7fad4806bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.900+0000 7fad4d000640 1 -- 172.21.15.17:0/1992368962 shutdown_connections 2024-03-19T06:38:34.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.900+0000 7fad4d000640 1 -- 172.21.15.17:0/1992368962 wait complete. 2024-03-19T06:38:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.902+0000 7fad4d000640 1 Processor -- start 2024-03-19T06:38:34.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.902+0000 7fad4d000640 1 -- start start 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c003a00 0x7fad4815ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad48159a30 0x7fad4814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815a650 con 0x7fad480ce5a0 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815a930 con 0x7fad48159a30 2024-03-19T06:38:34.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.903+0000 7fad4d000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4815d320 con 0x7fad2c003a00 2024-03-19T06:38:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.904+0000 7fad46800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.904+0000 7fad46800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48538/0 (socket says 172.21.15.17:48538) 2024-03-19T06:38:34.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.904+0000 7fad46800640 1 -- 172.21.15.17:0/1948499305 learned_addr learned my addr 172.21.15.17:0/1948499305 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:34.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.909+0000 7fad46800640 1 -- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c003a00 msgr2=0x7fad4815ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.909+0000 7fad46800640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c003a00 0x7fad4815ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.909+0000 7fad46800640 1 -- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad48159a30 msgr2=0x7fad4814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:34.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.909+0000 7fad46800640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad48159a30 0x7fad4814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:34.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.909+0000 7fad46800640 1 -- 172.21.15.17:0/1948499305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480cee50 con 0x7fad480ce5a0 2024-03-19T06:38:34.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.911+0000 7fad46800640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad4000ca90 tx=0x7fad4000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.915+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4000ae00 con 0x7fad480ce5a0 2024-03-19T06:38:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.915+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad40016420 con 0x7fad480ce5a0 2024-03-19T06:38:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.915+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad40016810 con 0x7fad480ce5a0 2024-03-19T06:38:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.915+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480cf130 con 0x7fad480ce5a0 2024-03-19T06:38:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.915+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad481f3720 con 0x7fad480ce5a0 2024-03-19T06:38:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.917+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48069be0 con 0x7fad480ce5a0 2024-03-19T06:38:34.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.941+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fad400169b0 con 0x7fad480ce5a0 2024-03-19T06:38:34.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.942+0000 7fad3e000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 0x7fad2406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:34.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.942+0000 7fad45e00640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 0x7fad2406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:34.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.943+0000 7fad45e00640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 0x7fad2406e0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad38033000 tx=0x7fad38007000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:34.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:34.945+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fad40057b10 con 0x7fad480ce5a0 2024-03-19T06:38:35.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.254+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fad40024020 con 0x7fad480ce5a0 2024-03-19T06:38:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.476+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fad481578e0 con 0x7fad480ce5a0 2024-03-19T06:38:35.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.489+0000 7fad3e000640 1 -- 172.21.15.17:0/1948499305 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v32) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad4005a170 con 0x7fad480ce5a0 2024-03-19T06:38:35.474 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 msgr2=0x7fad2406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 0x7fad2406e0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fad38033000 tx=0x7fad38007000 comp rx=0 tx=0).stop 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 msgr2=0x7fad480cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fad4000ca90 tx=0x7fad4000cf50 comp rx=0 tx=0).stop 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 shutdown_connections 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad480ce5a0 0x7fad480cc010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fad2406bc20 0x7fad2406e0e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad48159a30 0x7fad4814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 --2- 172.21.15.17:0/1948499305 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fad2c003a00 0x7fad4815ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 >> 172.21.15.17:0/1948499305 conn(0x7fad48066e10 msgr2=0x7fad480c4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 shutdown_connections 2024-03-19T06:38:35.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.492+0000 7fad4d000640 1 -- 172.21.15.17:0/1948499305 wait complete. 2024-03-19T06:38:35.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-19T06:38:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.723+0000 7f53f7c00640 1 Processor -- start 2024-03-19T06:38:35.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.724+0000 7f53f7c00640 1 -- start start 2024-03-19T06:38:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.725+0000 7f53f7c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53f0153ed0 0x7f53f015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.725+0000 7f53f7c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53f006eb90 0x7f53f0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.725+0000 7f53f7c00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f01542b0 con 0x7f53f006e720 2024-03-19T06:38:35.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.725+0000 7f53f7c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f006efa0 con 0x7f53f0153ed0 2024-03-19T06:38:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.725+0000 7f53f7c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f015e1d0 con 0x7f53f006eb90 2024-03-19T06:38:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.726+0000 7f53f5200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53f0153ed0 0x7f53f015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.727+0000 7f53f5200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f53f0153ed0 0x7f53f015aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48550/0 (socket says 172.21.15.17:48550) 2024-03-19T06:38:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.727+0000 7f53f5200640 1 -- 172.21.15.17:0/3288985463 learned_addr learned my addr 172.21.15.17:0/3288985463 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:35.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.728+0000 7f53f5c00640 1 --2- 172.21.15.17:0/3288985463 >> v2:172.21.15.153:3300/0 conn(0x7f53f006eb90 0x7f53f0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.729+0000 7f53f5200640 1 -- 172.21.15.17:0/3288985463 >> v2:172.21.15.153:3300/0 conn(0x7f53f006eb90 msgr2=0x7f53f0070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.729+0000 7f53f5200640 1 --2- 172.21.15.17:0/3288985463 >> v2:172.21.15.153:3300/0 conn(0x7f53f006eb90 0x7f53f0070d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.729+0000 7f53f5200640 1 -- 172.21.15.17:0/3288985463 >> v1:172.21.15.153:6789/0 conn(0x7f53f006e720 legacy=0x7f53f00c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:35.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.729+0000 7f53f5200640 1 -- 172.21.15.17:0/3288985463 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f015d5c0 con 0x7f53f0153ed0 2024-03-19T06:38:35.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.732+0000 7f53f5200640 1 --2- 172.21.15.17:0/3288985463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f015aa00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53f00732c0 tx=0x7f53e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d570f95083c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.736+0000 7f53ef400640 1 -- 172.21.15.17:0/3288985463 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4035020 con 0x7f53f0153ed0 2024-03-19T06:38:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.736+0000 7f53ef400640 1 -- 172.21.15.17:0/3288985463 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e4031870 con 0x7f53f0153ed0 2024-03-19T06:38:35.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.736+0000 7f53ef400640 1 -- 172.21.15.17:0/3288985463 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4031c40 con 0x7f53f0153ed0 2024-03-19T06:38:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 -- 172.21.15.17:0/3288985463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 msgr2=0x7f53f015aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 --2- 172.21.15.17:0/3288985463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f015aa00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f53f00732c0 tx=0x7f53e402b910 comp rx=0 tx=0).stop 2024-03-19T06:38:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 -- 172.21.15.17:0/3288985463 shutdown_connections 2024-03-19T06:38:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 --2- 172.21.15.17:0/3288985463 >> v2:172.21.15.153:3300/0 conn(0x7f53f006eb90 0x7f53f0070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 --2- 172.21.15.17:0/3288985463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f015aa00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 -- 172.21.15.17:0/3288985463 >> 172.21.15.17:0/3288985463 conn(0x7f53f00c8910 msgr2=0x7f53f00cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 -- 172.21.15.17:0/3288985463 shutdown_connections 2024-03-19T06:38:35.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.737+0000 7f53f7c00640 1 -- 172.21.15.17:0/3288985463 wait complete. 2024-03-19T06:38:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.739+0000 7f53f7c00640 1 Processor -- start 2024-03-19T06:38:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.739+0000 7f53f7c00640 1 -- start start 2024-03-19T06:38:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f006e720 0x7f53f0149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53f006eb90 0x7f53f00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015de60 con 0x7f53f0153ed0 2024-03-19T06:38:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015db80 con 0x7f53f006e720 2024-03-19T06:38:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.740+0000 7f53f7c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00c68f0 con 0x7f53f006eb90 2024-03-19T06:38:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.741+0000 7f53f5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.741+0000 7f53f5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48558/0 (socket says 172.21.15.17:48558) 2024-03-19T06:38:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.741+0000 7f53f5c00640 1 -- 172.21.15.17:0/2572856292 learned_addr learned my addr 172.21.15.17:0/2572856292 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.742+0000 7f53f5200640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f006e720 0x7f53f0149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.742+0000 7f53efe00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53f006eb90 0x7f53f00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.745+0000 7f53f5c00640 1 -- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53f006eb90 msgr2=0x7f53f00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.745+0000 7f53f5c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53f006eb90 0x7f53f00c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.745+0000 7f53f5c00640 1 -- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f006e720 msgr2=0x7f53f0149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.745+0000 7f53f5c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f006e720 0x7f53f0149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:35.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.745+0000 7f53f5c00640 1 -- 172.21.15.17:0/2572856292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0158080 con 0x7f53f0153ed0 2024-03-19T06:38:35.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.748+0000 7f53f5c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53e800cd70 tx=0x7f53e800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.752+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8003b90 con 0x7f53f0153ed0 2024-03-19T06:38:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.752+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8003d30 con 0x7f53f0153ed0 2024-03-19T06:38:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.752+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8004240 con 0x7f53f0153ed0 2024-03-19T06:38:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.752+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f0158360 con 0x7f53f0153ed0 2024-03-19T06:38:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.752+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f0158920 con 0x7f53f0153ed0 2024-03-19T06:38:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.754+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f0069be0 con 0x7f53f0153ed0 2024-03-19T06:38:35.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.778+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f53e80043e0 con 0x7f53f0153ed0 2024-03-19T06:38:35.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.779+0000 7f53ecc00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 0x7f53d006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:35.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.780+0000 7f53f5200640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 0x7f53d006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:35.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.782+0000 7f53f5200640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 0x7f53d006e0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53e4036000 tx=0x7f53e403c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:35.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:35.782+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f53e8057d90 con 0x7f53f0153ed0 2024-03-19T06:38:36.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.097+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f53e8059cf0 con 0x7f53f0153ed0 2024-03-19T06:38:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.341+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f53f00c6d40 con 0x7f53f0153ed0 2024-03-19T06:38:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.462+0000 7f53ecc00640 1 -- 172.21.15.17:0/2572856292 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7f53e805dd90 con 0x7f53f0153ed0 2024-03-19T06:38:36.448 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-19T06:38:36.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 msgr2=0x7f53d006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 0x7f53d006e0e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f53e4036000 tx=0x7f53e403c040 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 msgr2=0x7f53f00c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f53e800cd70 tx=0x7f53e800a660 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 shutdown_connections 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f53f0153ed0 0x7f53f00c9d70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f53f006eb90 0x7f53f00c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f53d006bc20 0x7f53d006e0e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 --2- 172.21.15.17:0/2572856292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f006e720 0x7f53f0149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 >> 172.21.15.17:0/2572856292 conn(0x7f53f00c8910 msgr2=0x7f53f00c39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 shutdown_connections 2024-03-19T06:38:36.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:36.466+0000 7f53f7c00640 1 -- 172.21.15.17:0/2572856292 wait complete. 2024-03-19T06:38:36.472 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-03-19T06:38:36.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:38:36.472 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-19T06:38:36.553 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:38:36.590 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[46330]: fuse finished with error 0 and tester_r 0 2024-03-19T06:38:37.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:==00:00:30:34.748 46330== 2024-03-19T06:38:37.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:==00:00:30:34.748 46330== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:38:37.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:38:42.655 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:38:42.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:38:42.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:38:42.656 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-19T06:38:42.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:38:42.717 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-19T06:38:42.772 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-19T06:38:42.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:38:42.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-19T06:38:42.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-19T06:38:42.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-19T06:38:42.988 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-19T06:38:42.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-19T06:38:42.997 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:38:43.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.210+0000 7f9732200640 1 Processor -- start 2024-03-19T06:38:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.210+0000 7f9732200640 1 -- start start 2024-03-19T06:38:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.212+0000 7f9732200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 0x7f972c071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.212+0000 7f9732200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0716a0 con 0x7f972c15aa00 2024-03-19T06:38:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.212+0000 7f9732200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c1542b0 con 0x7f972c153ed0 2024-03-19T06:38:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.212+0000 7f9732200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15e1d0 con 0x7f972c070d30 2024-03-19T06:38:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.213+0000 7f972aa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f972c15aa00 0x7f972c0c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38708/0 (socket says 172.21.15.17:38708) 2024-03-19T06:38:43.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.213+0000 7f972aa00640 1 -- 172.21.15.17:0/1458960353 learned_addr learned my addr 172.21.15.17:0/1458960353 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:43.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.214+0000 7f972be00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 0x7f972c071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.216+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023642862 0 0) 0x7f972c0716a0 con 0x7f972c15aa00 2024-03-19T06:38:43.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.216+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9710003520 con 0x7f972c15aa00 2024-03-19T06:38:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641661536 0 0) 0x7f9710003520 con 0x7f972c15aa00 2024-03-19T06:38:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 msgr2=0x7f972c071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 0x7f972c071160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 >> v1:172.21.15.153:6789/0 conn(0x7f972c153ed0 legacy=0x7f972c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c15d5c0 con 0x7f972c15aa00 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f971c001670 con 0x7f972c15aa00 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 >> v1:172.21.15.17:6789/0 conn(0x7f972c15aa00 legacy=0x7f972c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 0x7f97100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9710003fb0 0x7f9710004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9710004d40 0x7f97100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15e1d0 con 0x7f9710003fb0 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971000bb90 con 0x7f9710004d40 2024-03-19T06:38:43.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.221+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971000bd90 con 0x7f972c070d30 2024-03-19T06:38:43.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.225+0000 7f972aa00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9710003fb0 0x7f9710004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.227+0000 7f972be00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9710004d40 0x7f97100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.229+0000 7f972aa00640 1 -- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 msgr2=0x7f97100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.229+0000 7f972aa00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c070d30 0x7f97100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.229+0000 7f972aa00640 1 -- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9710004d40 msgr2=0x7f97100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.229+0000 7f972aa00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9710004d40 0x7f97100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.229+0000 7f972aa00640 1 -- 172.21.15.17:0/1458960353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710003520 con 0x7f9710003fb0 2024-03-19T06:38:43.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.231+0000 7f972aa00640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9710003fb0 0x7f9710004800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c110 tx=0x7f9710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba86d0a8e7c1985f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.236+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c007c40 con 0x7f9710003fb0 2024-03-19T06:38:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.236+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c030070 con 0x7f9710003fb0 2024-03-19T06:38:43.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.236+0000 7f972a000640 1 -- 172.21.15.17:0/1458960353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c005d70 con 0x7f9710003fb0 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 -- 172.21.15.17:0/1458960353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9710003fb0 msgr2=0x7f9710004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 --2- 172.21.15.17:0/1458960353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9710003fb0 0x7f9710004800 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f971c00c110 tx=0x7f9710005830 comp rx=0 tx=0).stop 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f972be00640 1 -- 172.21.15.17:0/1458960353 reap_dead start 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 -- 172.21.15.17:0/1458960353 shutdown_connections 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 -- 172.21.15.17:0/1458960353 >> 172.21.15.17:0/1458960353 conn(0x7f972c0c8910 msgr2=0x7f972c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 -- 172.21.15.17:0/1458960353 shutdown_connections 2024-03-19T06:38:43.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.237+0000 7f9732200640 1 -- 172.21.15.17:0/1458960353 wait complete. 2024-03-19T06:38:43.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.239+0000 7f9732200640 1 Processor -- start 2024-03-19T06:38:43.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 -- start start 2024-03-19T06:38:43.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c14d410 0x7f972c1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c1e3280 0x7f972c1e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15de60 con 0x7f972c14d7f0 2024-03-19T06:38:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15db80 con 0x7f972c14d410 2024-03-19T06:38:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.240+0000 7f9732200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c06ee30 con 0x7f972c1e3280 2024-03-19T06:38:43.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.241+0000 7f972be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.242+0000 7f972be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60332/0 (socket says 172.21.15.17:60332) 2024-03-19T06:38:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.242+0000 7f972be00640 1 -- 172.21.15.17:0/69412163 learned_addr learned my addr 172.21.15.17:0/69412163 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:43.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.242+0000 7f972b400640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c14d410 0x7f972c1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.246+0000 7f972be00640 1 -- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c1e3280 msgr2=0x7f972c1e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.246+0000 7f972be00640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c1e3280 0x7f972c1e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.246+0000 7f972be00640 1 -- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c14d410 msgr2=0x7f972c1f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.246+0000 7f972be00640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c14d410 0x7f972c1f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.246+0000 7f972be00640 1 -- 172.21.15.17:0/69412163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c1e3710 con 0x7f972c14d7f0 2024-03-19T06:38:43.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.249+0000 7f972be00640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f972c06c350 tx=0x7f9724009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:43.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.253+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724011d40 con 0x7f972c14d7f0 2024-03-19T06:38:43.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.253+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972401b070 con 0x7f972c14d7f0 2024-03-19T06:38:43.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.253+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724003990 con 0x7f972c14d7f0 2024-03-19T06:38:43.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.253+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c1e39f0 con 0x7f972c14d7f0 2024-03-19T06:38:43.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.253+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c154c30 con 0x7f972c14d7f0 2024-03-19T06:38:43.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.255+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c069be0 con 0x7f972c14d7f0 2024-03-19T06:38:43.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.584+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f9724005d10 con 0x7f972c14d7f0 2024-03-19T06:38:43.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.586+0000 7f9723400640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 0x7f970806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:43.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.587+0000 7f972b400640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 0x7f970806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:43.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.588+0000 7f972b400640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 0x7f970806e0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9714001160 tx=0x7f9714009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:43.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.621+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9724058240 con 0x7f972c14d7f0 2024-03-19T06:38:43.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.622+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f9724025020 con 0x7f972c14d7f0 2024-03-19T06:38:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.840+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f972c1599f0 con 0x7f970806bc20 2024-03-19T06:38:43.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.868+0000 7f9723400640 1 -- 172.21.15.17:0/69412163 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+333546 (secure 0 0 0) 0x7f971400f7d0 con 0x7f970806bc20 2024-03-19T06:38:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:43.860 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:38:43.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 msgr2=0x7f970806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 0x7f970806e0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9714001160 tx=0x7f9714009040 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 msgr2=0x7f972c158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f972c06c350 tx=0x7f9724009f90 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 shutdown_connections 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f972c14d7f0 0x7f972c158cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f972c1e3280 0x7f972c1e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f970806bc20 0x7f970806e0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 --2- 172.21.15.17:0/69412163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f972c14d410 0x7f972c1f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.874+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 >> 172.21.15.17:0/69412163 conn(0x7f972c0c8910 msgr2=0x7f972c0c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.875+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 shutdown_connections 2024-03-19T06:38:43.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:43.875+0000 7f9732200640 1 -- 172.21.15.17:0/69412163 wait complete. 2024-03-19T06:38:43.880 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":1001,"stamp":"2024-03-19T06:38:42.245875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22602369,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":597,"num_read_kb":611,"num_write":9426,"num_write_kb":277524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317256,"kb_used_data":47048,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657464,"statfs":{"total":773094113280,"available":772769243136,"internally_reserved":0,"allocated":48177152,"data_stored":46337237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12157,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005015"},"pg_stats":[{"pgid":"2.1f","version":"32'658","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.067199+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:37:46.067199+0000","last_peered":"2024-03-19T06:37:46.067199+0000","last_clean":"2024-03-19T06:37:46.067199+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:37:46.067199+0000","last_undegraded":"2024-03-19T06:37:46.067199+0000","last_fullsized":"2024-03-19T06:37:46.067199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'15","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.154291+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:38:37.154291+0000","last_peered":"2024-03-19T06:38:37.154291+0000","last_clean":"2024-03-19T06:38:37.154291+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:38:37.154291+0000","last_undegraded":"2024-03-19T06:38:37.154291+0000","last_fullsized":"2024-03-19T06:38:37.154291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'60","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.594249+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:37:15.594249+0000","last_peered":"2024-03-19T06:37:15.594249+0000","last_clean":"2024-03-19T06:37:15.594249+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:37:15.594249+0000","last_undegraded":"2024-03-19T06:37:15.594249+0000","last_fullsized":"2024-03-19T06:37:15.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'93","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.466869+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:38:37.466869+0000","last_peered":"2024-03-19T06:38:37.466869+0000","last_clean":"2024-03-19T06:38:37.466869+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:38:37.466869+0000","last_undegraded":"2024-03-19T06:38:37.466869+0000","last_fullsized":"2024-03-19T06:38:37.466869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":914551,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171494+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:38:37.171494+0000","last_peered":"2024-03-19T06:38:37.171494+0000","last_clean":"2024-03-19T06:38:37.171494+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:38:37.171494+0000","last_undegraded":"2024-03-19T06:38:37.171494+0000","last_fullsized":"2024-03-19T06:38:37.171494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'63","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:55.649400+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:36:55.649400+0000","last_peered":"2024-03-19T06:36:55.649400+0000","last_clean":"2024-03-19T06:36:55.649400+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:36:55.649400+0000","last_undegraded":"2024-03-19T06:36:55.649400+0000","last_fullsized":"2024-03-19T06:36:55.649400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.779829+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:38:11.779829+0000","last_peered":"2024-03-19T06:38:11.779829+0000","last_clean":"2024-03-19T06:38:11.779829+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:38:11.779829+0000","last_undegraded":"2024-03-19T06:38:11.779829+0000","last_fullsized":"2024-03-19T06:38:11.779829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085166+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:38:37.085166+0000","last_peered":"2024-03-19T06:38:37.085166+0000","last_clean":"2024-03-19T06:38:37.085166+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:38:37.085166+0000","last_undegraded":"2024-03-19T06:38:37.085166+0000","last_fullsized":"2024-03-19T06:38:37.085166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'72","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.947835+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:37:12.947835+0000","last_peered":"2024-03-19T06:37:12.947835+0000","last_clean":"2024-03-19T06:37:12.947835+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:37:12.947835+0000","last_undegraded":"2024-03-19T06:37:12.947835+0000","last_fullsized":"2024-03-19T06:37:12.947835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:33.116946+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:36:33.116946+0000","last_peered":"2024-03-19T06:36:33.116946+0000","last_clean":"2024-03-19T06:36:33.116946+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:36:33.116946+0000","last_undegraded":"2024-03-19T06:36:33.116946+0000","last_fullsized":"2024-03-19T06:36:33.116946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038109+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:38:37.038109+0000","last_peered":"2024-03-19T06:38:37.038109+0000","last_clean":"2024-03-19T06:38:37.038109+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:38:37.038109+0000","last_undegraded":"2024-03-19T06:38:37.038109+0000","last_fullsized":"2024-03-19T06:38:37.038109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.839487+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:37:17.839487+0000","last_peered":"2024-03-19T06:37:17.839487+0000","last_clean":"2024-03-19T06:37:17.839487+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:37:17.839487+0000","last_undegraded":"2024-03-19T06:37:17.839487+0000","last_fullsized":"2024-03-19T06:37:17.839487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266186+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:38:37.266186+0000","last_peered":"2024-03-19T06:38:37.266186+0000","last_clean":"2024-03-19T06:38:37.266186+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:38:37.266186+0000","last_undegraded":"2024-03-19T06:38:37.266186+0000","last_fullsized":"2024-03-19T06:38:37.266186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'679","reported_seq":726,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:03.132901+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:38:03.132901+0000","last_peered":"2024-03-19T06:38:03.132901+0000","last_clean":"2024-03-19T06:38:03.132901+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:38:03.132901+0000","last_undegraded":"2024-03-19T06:38:03.132901+0000","last_fullsized":"2024-03-19T06:38:03.132901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'61","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.740237+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:37:19.740237+0000","last_peered":"2024-03-19T06:37:19.740237+0000","last_clean":"2024-03-19T06:37:19.740237+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:37:19.740237+0000","last_undegraded":"2024-03-19T06:37:19.740237+0000","last_fullsized":"2024-03-19T06:37:19.740237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173890+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:38:37.173890+0000","last_peered":"2024-03-19T06:38:37.173890+0000","last_clean":"2024-03-19T06:38:37.173890+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:38:37.173890+0000","last_undegraded":"2024-03-19T06:38:37.173890+0000","last_fullsized":"2024-03-19T06:38:37.173890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:51.658227+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:37:51.658227+0000","last_peered":"2024-03-19T06:37:51.658227+0000","last_clean":"2024-03-19T06:37:51.658227+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:37:51.658227+0000","last_undegraded":"2024-03-19T06:37:51.658227+0000","last_fullsized":"2024-03-19T06:37:51.658227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'90","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.611055+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:37:19.611055+0000","last_peered":"2024-03-19T06:37:19.611055+0000","last_clean":"2024-03-19T06:37:19.611055+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:37:19.611055+0000","last_undegraded":"2024-03-19T06:37:19.611055+0000","last_fullsized":"2024-03-19T06:37:19.611055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":8470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159403+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:38:37.159403+0000","last_peered":"2024-03-19T06:38:37.159403+0000","last_clean":"2024-03-19T06:38:37.159403+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:38:37.159403+0000","last_undegraded":"2024-03-19T06:38:37.159403+0000","last_fullsized":"2024-03-19T06:38:37.159403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:31.382833+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:37:31.382833+0000","last_peered":"2024-03-19T06:37:31.382833+0000","last_clean":"2024-03-19T06:37:31.382833+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:37:31.382833+0000","last_undegraded":"2024-03-19T06:37:31.382833+0000","last_fullsized":"2024-03-19T06:37:31.382833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'65","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.616840+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:37:15.616840+0000","last_peered":"2024-03-19T06:37:15.616840+0000","last_clean":"2024-03-19T06:37:15.616840+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:37:15.616840+0000","last_undegraded":"2024-03-19T06:37:15.616840+0000","last_fullsized":"2024-03-19T06:37:15.616840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":11230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.509408+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:37:18.509408+0000","last_peered":"2024-03-19T06:37:18.509408+0000","last_clean":"2024-03-19T06:37:18.509408+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:37:18.509408+0000","last_undegraded":"2024-03-19T06:37:18.509408+0000","last_fullsized":"2024-03-19T06:37:18.509408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'9","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.838516+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:38:10.838516+0000","last_peered":"2024-03-19T06:38:10.838516+0000","last_clean":"2024-03-19T06:38:10.838516+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:38:10.838516+0000","last_undegraded":"2024-03-19T06:38:10.838516+0000","last_fullsized":"2024-03-19T06:38:10.838516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'67","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.511740+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:37:18.511740+0000","last_peered":"2024-03-19T06:37:18.511740+0000","last_clean":"2024-03-19T06:37:18.511740+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:37:18.511740+0000","last_undegraded":"2024-03-19T06:37:18.511740+0000","last_fullsized":"2024-03-19T06:37:18.511740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'28","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173332+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:38:37.173332+0000","last_peered":"2024-03-19T06:38:37.173332+0000","last_clean":"2024-03-19T06:38:37.173332+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:38:37.173332+0000","last_undegraded":"2024-03-19T06:38:37.173332+0000","last_fullsized":"2024-03-19T06:38:37.173332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.763816+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:38:11.763816+0000","last_peered":"2024-03-19T06:38:11.763816+0000","last_clean":"2024-03-19T06:38:11.763816+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:38:11.763816+0000","last_undegraded":"2024-03-19T06:38:11.763816+0000","last_fullsized":"2024-03-19T06:38:11.763816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'50","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.829685+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:37:17.829685+0000","last_peered":"2024-03-19T06:37:17.829685+0000","last_clean":"2024-03-19T06:37:17.829685+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:37:17.829685+0000","last_undegraded":"2024-03-19T06:37:17.829685+0000","last_fullsized":"2024-03-19T06:37:17.829685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160467+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:38:37.160467+0000","last_peered":"2024-03-19T06:38:37.160467+0000","last_clean":"2024-03-19T06:38:37.160467+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:38:37.160467+0000","last_undegraded":"2024-03-19T06:38:37.160467+0000","last_fullsized":"2024-03-19T06:38:37.160467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'1210","reported_seq":1257,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:29.328934+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:38:29.328934+0000","last_peered":"2024-03-19T06:38:29.328934+0000","last_clean":"2024-03-19T06:38:29.328934+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:38:29.328934+0000","last_undegraded":"2024-03-19T06:38:29.328934+0000","last_fullsized":"2024-03-19T06:38:29.328934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'85","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.611281+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:37:14.611281+0000","last_peered":"2024-03-19T06:37:14.611281+0000","last_clean":"2024-03-19T06:37:14.611281+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:37:14.611281+0000","last_undegraded":"2024-03-19T06:37:14.611281+0000","last_fullsized":"2024-03-19T06:37:14.611281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":11129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030046+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:38:37.030046+0000","last_peered":"2024-03-19T06:38:37.030046+0000","last_clean":"2024-03-19T06:38:37.030046+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:38:37.030046+0000","last_undegraded":"2024-03-19T06:38:37.030046+0000","last_fullsized":"2024-03-19T06:38:37.030046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:53.131139+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:37:53.131139+0000","last_peered":"2024-03-19T06:37:53.131139+0000","last_clean":"2024-03-19T06:37:53.131139+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:37:53.131139+0000","last_undegraded":"2024-03-19T06:37:53.131139+0000","last_fullsized":"2024-03-19T06:37:53.131139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'48","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.734172+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:37:19.734172+0000","last_peered":"2024-03-19T06:37:19.734172+0000","last_clean":"2024-03-19T06:37:19.734172+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:37:19.734172+0000","last_undegraded":"2024-03-19T06:37:19.734172+0000","last_fullsized":"2024-03-19T06:37:19.734172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":5603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026364+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:38:37.026364+0000","last_peered":"2024-03-19T06:38:37.026364+0000","last_clean":"2024-03-19T06:38:37.026364+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:38:37.026364+0000","last_undegraded":"2024-03-19T06:38:37.026364+0000","last_fullsized":"2024-03-19T06:38:37.026364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:47.292216+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:37:47.292216+0000","last_peered":"2024-03-19T06:37:47.292216+0000","last_clean":"2024-03-19T06:37:47.292216+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:37:47.292216+0000","last_undegraded":"2024-03-19T06:37:47.292216+0000","last_fullsized":"2024-03-19T06:37:47.292216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'69","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.597812+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:37:14.597812+0000","last_peered":"2024-03-19T06:37:14.597812+0000","last_clean":"2024-03-19T06:37:14.597812+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:37:14.597812+0000","last_undegraded":"2024-03-19T06:37:14.597812+0000","last_fullsized":"2024-03-19T06:37:14.597812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026235+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:38:37.026235+0000","last_peered":"2024-03-19T06:38:37.026235+0000","last_clean":"2024-03-19T06:38:37.026235+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:38:37.026235+0000","last_undegraded":"2024-03-19T06:38:37.026235+0000","last_fullsized":"2024-03-19T06:38:37.026235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.337649+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:38:20.337649+0000","last_peered":"2024-03-19T06:38:20.337649+0000","last_clean":"2024-03-19T06:38:20.337649+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:38:20.337649+0000","last_undegraded":"2024-03-19T06:38:20.337649+0000","last_fullsized":"2024-03-19T06:38:20.337649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'57","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.743175+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:37:19.743175+0000","last_peered":"2024-03-19T06:37:19.743175+0000","last_clean":"2024-03-19T06:37:19.743175+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:37:19.743175+0000","last_undegraded":"2024-03-19T06:37:19.743175+0000","last_fullsized":"2024-03-19T06:37:19.743175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'24","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031547+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:38:37.031547+0000","last_peered":"2024-03-19T06:38:37.031547+0000","last_clean":"2024-03-19T06:38:37.031547+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:38:37.031547+0000","last_undegraded":"2024-03-19T06:38:37.031547+0000","last_fullsized":"2024-03-19T06:38:37.031547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'498","reported_seq":1027,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:25.505665+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:38:25.505665+0000","last_peered":"2024-03-19T06:38:25.505665+0000","last_clean":"2024-03-19T06:38:25.505665+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:38:25.505665+0000","last_undegraded":"2024-03-19T06:38:25.505665+0000","last_fullsized":"2024-03-19T06:38:25.505665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117202,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":494,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'60","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618658+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:37:15.618658+0000","last_peered":"2024-03-19T06:37:15.618658+0000","last_clean":"2024-03-19T06:37:15.618658+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:37:15.618658+0000","last_undegraded":"2024-03-19T06:37:15.618658+0000","last_fullsized":"2024-03-19T06:37:15.618658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'13","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.167195+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:38:37.167195+0000","last_peered":"2024-03-19T06:38:37.167195+0000","last_clean":"2024-03-19T06:38:37.167195+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:38:37.167195+0000","last_undegraded":"2024-03-19T06:38:37.167195+0000","last_fullsized":"2024-03-19T06:38:37.167195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:23.529286+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:38:23.529286+0000","last_peered":"2024-03-19T06:38:23.529286+0000","last_clean":"2024-03-19T06:38:23.529286+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:38:23.529286+0000","last_undegraded":"2024-03-19T06:38:23.529286+0000","last_fullsized":"2024-03-19T06:38:23.529286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'93","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.098216+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:37:17.098216+0000","last_peered":"2024-03-19T06:37:17.098216+0000","last_clean":"2024-03-19T06:37:17.098216+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:37:17.098216+0000","last_undegraded":"2024-03-19T06:37:17.098216+0000","last_fullsized":"2024-03-19T06:37:17.098216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.153982+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:38:37.153982+0000","last_peered":"2024-03-19T06:38:37.153982+0000","last_clean":"2024-03-19T06:38:37.153982+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:38:37.153982+0000","last_undegraded":"2024-03-19T06:38:37.153982+0000","last_fullsized":"2024-03-19T06:38:37.153982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'11","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.348283+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:38:20.348283+0000","last_peered":"2024-03-19T06:38:20.348283+0000","last_clean":"2024-03-19T06:38:20.348283+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:38:20.348283+0000","last_undegraded":"2024-03-19T06:38:20.348283+0000","last_fullsized":"2024-03-19T06:38:20.348283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:18.113959+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:36:18.113959+0000","last_peered":"2024-03-19T06:36:18.113959+0000","last_clean":"2024-03-19T06:36:18.113959+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:36:18.113959+0000","last_undegraded":"2024-03-19T06:36:18.113959+0000","last_fullsized":"2024-03-19T06:36:18.113959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'67","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.095497+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:37:17.095497+0000","last_peered":"2024-03-19T06:37:17.095497+0000","last_clean":"2024-03-19T06:37:17.095497+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:37:17.095497+0000","last_undegraded":"2024-03-19T06:37:17.095497+0000","last_fullsized":"2024-03-19T06:37:17.095497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087488+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:38:37.087488+0000","last_peered":"2024-03-19T06:38:37.087488+0000","last_clean":"2024-03-19T06:38:37.087488+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:38:37.087488+0000","last_undegraded":"2024-03-19T06:38:37.087488+0000","last_fullsized":"2024-03-19T06:38:37.087488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:02.268841+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:38:02.268841+0000","last_peered":"2024-03-19T06:38:02.268841+0000","last_clean":"2024-03-19T06:38:02.268841+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:38:02.268841+0000","last_undegraded":"2024-03-19T06:38:02.268841+0000","last_fullsized":"2024-03-19T06:38:02.268841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'77","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:07.191063+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:37:07.191063+0000","last_peered":"2024-03-19T06:37:07.191063+0000","last_clean":"2024-03-19T06:37:07.191063+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:37:07.191063+0000","last_undegraded":"2024-03-19T06:37:07.191063+0000","last_fullsized":"2024-03-19T06:37:07.191063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.020683+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:38:37.020683+0000","last_peered":"2024-03-19T06:38:37.020683+0000","last_clean":"2024-03-19T06:38:37.020683+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:38:37.020683+0000","last_undegraded":"2024-03-19T06:38:37.020683+0000","last_fullsized":"2024-03-19T06:38:37.020683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.370830+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:38:05.370830+0000","last_peered":"2024-03-19T06:38:05.370830+0000","last_clean":"2024-03-19T06:38:05.370830+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:38:05.370830+0000","last_undegraded":"2024-03-19T06:38:05.370830+0000","last_fullsized":"2024-03-19T06:38:05.370830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'101","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.547085+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:37:18.547085+0000","last_peered":"2024-03-19T06:37:18.547085+0000","last_clean":"2024-03-19T06:37:18.547085+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:37:18.547085+0000","last_undegraded":"2024-03-19T06:37:18.547085+0000","last_fullsized":"2024-03-19T06:37:18.547085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":8077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087400+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:38:37.087400+0000","last_peered":"2024-03-19T06:38:37.087400+0000","last_clean":"2024-03-19T06:38:37.087400+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:38:37.087400+0000","last_undegraded":"2024-03-19T06:38:37.087400+0000","last_fullsized":"2024-03-19T06:38:37.087400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.963636+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:37:38.963636+0000","last_peered":"2024-03-19T06:37:38.963636+0000","last_clean":"2024-03-19T06:37:38.963636+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:37:38.963636+0000","last_undegraded":"2024-03-19T06:37:38.963636+0000","last_fullsized":"2024-03-19T06:37:38.963636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'66","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.569020+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:37:12.569020+0000","last_peered":"2024-03-19T06:37:12.569020+0000","last_clean":"2024-03-19T06:37:12.569020+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:37:12.569020+0000","last_undegraded":"2024-03-19T06:37:12.569020+0000","last_fullsized":"2024-03-19T06:37:12.569020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'16","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032178+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:38:37.032178+0000","last_peered":"2024-03-19T06:38:37.032178+0000","last_clean":"2024-03-19T06:38:37.032178+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:38:37.032178+0000","last_undegraded":"2024-03-19T06:38:37.032178+0000","last_fullsized":"2024-03-19T06:38:37.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.047495+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:38:16.047495+0000","last_peered":"2024-03-19T06:38:16.047495+0000","last_clean":"2024-03-19T06:38:16.047495+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:38:16.047495+0000","last_undegraded":"2024-03-19T06:38:16.047495+0000","last_fullsized":"2024-03-19T06:38:16.047495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'94","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.007381+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:37:17.007381+0000","last_peered":"2024-03-19T06:37:17.007381+0000","last_clean":"2024-03-19T06:37:17.007381+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:37:17.007381+0000","last_undegraded":"2024-03-19T06:37:17.007381+0000","last_fullsized":"2024-03-19T06:37:17.007381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'23","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.029144+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:38:37.029144+0000","last_peered":"2024-03-19T06:38:37.029144+0000","last_clean":"2024-03-19T06:38:37.029144+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:38:37.029144+0000","last_undegraded":"2024-03-19T06:38:37.029144+0000","last_fullsized":"2024-03-19T06:38:37.029144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:42.862515+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:37:42.862515+0000","last_peered":"2024-03-19T06:37:42.862515+0000","last_clean":"2024-03-19T06:37:42.862515+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:37:42.862515+0000","last_undegraded":"2024-03-19T06:37:42.862515+0000","last_fullsized":"2024-03-19T06:37:42.862515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'78","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.504900+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:37:15.504900+0000","last_peered":"2024-03-19T06:37:15.504900+0000","last_clean":"2024-03-19T06:37:15.504900+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:37:15.504900+0000","last_undegraded":"2024-03-19T06:37:15.504900+0000","last_fullsized":"2024-03-19T06:37:15.504900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.255304+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:38:37.255304+0000","last_peered":"2024-03-19T06:38:37.255304+0000","last_clean":"2024-03-19T06:38:37.255304+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:38:37.255304+0000","last_undegraded":"2024-03-19T06:38:37.255304+0000","last_fullsized":"2024-03-19T06:38:37.255304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:52.188328+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:36:52.188328+0000","last_peered":"2024-03-19T06:36:52.188328+0000","last_clean":"2024-03-19T06:36:52.188328+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:36:52.188328+0000","last_undegraded":"2024-03-19T06:36:52.188328+0000","last_fullsized":"2024-03-19T06:36:52.188328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'70","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.601649+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:37:19.601649+0000","last_peered":"2024-03-19T06:37:19.601649+0000","last_clean":"2024-03-19T06:37:19.601649+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:37:19.601649+0000","last_undegraded":"2024-03-19T06:37:19.601649+0000","last_fullsized":"2024-03-19T06:37:19.601649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'36","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.089634+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:38:37.089634+0000","last_peered":"2024-03-19T06:38:37.089634+0000","last_clean":"2024-03-19T06:38:37.089634+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:38:37.089634+0000","last_undegraded":"2024-03-19T06:38:37.089634+0000","last_fullsized":"2024-03-19T06:38:37.089634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:17.098272+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:38:17.098272+0000","last_peered":"2024-03-19T06:38:17.098272+0000","last_clean":"2024-03-19T06:38:17.098272+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:38:17.098272+0000","last_undegraded":"2024-03-19T06:38:17.098272+0000","last_fullsized":"2024-03-19T06:38:17.098272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.589025+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:37:05.589025+0000","last_peered":"2024-03-19T06:37:05.589025+0000","last_clean":"2024-03-19T06:37:05.589025+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:37:05.589025+0000","last_undegraded":"2024-03-19T06:37:05.589025+0000","last_fullsized":"2024-03-19T06:37:05.589025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.170926+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:38:37.170926+0000","last_peered":"2024-03-19T06:38:37.170926+0000","last_clean":"2024-03-19T06:38:37.170926+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:38:37.170926+0000","last_undegraded":"2024-03-19T06:38:37.170926+0000","last_fullsized":"2024-03-19T06:38:37.170926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:34:32.448275+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:34:32.448275+0000","last_peered":"2024-03-19T06:34:32.448275+0000","last_clean":"2024-03-19T06:34:32.448275+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:34:32.448275+0000","last_undegraded":"2024-03-19T06:34:32.448275+0000","last_fullsized":"2024-03-19T06:34:32.448275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'61","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.735140+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:37:17.735140+0000","last_peered":"2024-03-19T06:37:17.735140+0000","last_clean":"2024-03-19T06:37:17.735140+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:37:17.735140+0000","last_undegraded":"2024-03-19T06:37:17.735140+0000","last_fullsized":"2024-03-19T06:37:17.735140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'18","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.021602+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:38:37.021602+0000","last_peered":"2024-03-19T06:38:37.021602+0000","last_clean":"2024-03-19T06:38:37.021602+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:38:37.021602+0000","last_undegraded":"2024-03-19T06:38:37.021602+0000","last_fullsized":"2024-03-19T06:38:37.021602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'840","reported_seq":886,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.113886+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:38:16.113886+0000","last_peered":"2024-03-19T06:38:16.113886+0000","last_clean":"2024-03-19T06:38:16.113886+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:38:16.113886+0000","last_undegraded":"2024-03-19T06:38:16.113886+0000","last_fullsized":"2024-03-19T06:38:16.113886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'84","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618484+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:37:15.618484+0000","last_peered":"2024-03-19T06:37:15.618484+0000","last_clean":"2024-03-19T06:37:15.618484+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:37:15.618484+0000","last_undegraded":"2024-03-19T06:37:15.618484+0000","last_fullsized":"2024-03-19T06:37:15.618484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":13735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'24","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037016+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:38:37.037016+0000","last_peered":"2024-03-19T06:38:37.037016+0000","last_clean":"2024-03-19T06:38:37.037016+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:38:37.037016+0000","last_undegraded":"2024-03-19T06:38:37.037016+0000","last_fullsized":"2024-03-19T06:38:37.037016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'333","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:24.527850+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:38:24.527850+0000","last_peered":"2024-03-19T06:38:24.527850+0000","last_clean":"2024-03-19T06:38:24.527850+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:38:24.527850+0000","last_undegraded":"2024-03-19T06:38:24.527850+0000","last_fullsized":"2024-03-19T06:38:24.527850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'115","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.249693+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:37:03.249693+0000","last_peered":"2024-03-19T06:37:03.249693+0000","last_clean":"2024-03-19T06:37:03.249693+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:37:03.249693+0000","last_undegraded":"2024-03-19T06:37:03.249693+0000","last_fullsized":"2024-03-19T06:37:03.249693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":11739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'25","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171351+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:38:37.171351+0000","last_peered":"2024-03-19T06:38:37.171351+0000","last_clean":"2024-03-19T06:38:37.171351+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:38:37.171351+0000","last_undegraded":"2024-03-19T06:38:37.171351+0000","last_fullsized":"2024-03-19T06:38:37.171351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:06.360670+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:38:06.360670+0000","last_peered":"2024-03-19T06:38:06.360670+0000","last_clean":"2024-03-19T06:38:06.360670+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:38:06.360670+0000","last_undegraded":"2024-03-19T06:38:06.360670+0000","last_fullsized":"2024-03-19T06:38:06.360670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'77","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:06.179460+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:37:06.179460+0000","last_peered":"2024-03-19T06:37:06.179460+0000","last_clean":"2024-03-19T06:37:06.179460+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:37:06.179460+0000","last_undegraded":"2024-03-19T06:37:06.179460+0000","last_fullsized":"2024-03-19T06:37:06.179460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.063076+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:38:37.063076+0000","last_peered":"2024-03-19T06:38:37.063076+0000","last_clean":"2024-03-19T06:38:37.063076+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:38:37.063076+0000","last_undegraded":"2024-03-19T06:38:37.063076+0000","last_fullsized":"2024-03-19T06:38:37.063076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.662309+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:38:36.662309+0000","last_peered":"2024-03-19T06:38:36.662309+0000","last_clean":"2024-03-19T06:38:36.662309+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:38:36.662309+0000","last_undegraded":"2024-03-19T06:38:36.662309+0000","last_fullsized":"2024-03-19T06:38:36.662309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'86","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.001662+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:37:17.001662+0000","last_peered":"2024-03-19T06:37:17.001662+0000","last_clean":"2024-03-19T06:37:17.001662+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:37:17.001662+0000","last_undegraded":"2024-03-19T06:37:17.001662+0000","last_fullsized":"2024-03-19T06:37:17.001662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":9535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'52","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.126017+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:37:03.126017+0000","last_peered":"2024-03-19T06:37:03.126017+0000","last_clean":"2024-03-19T06:37:03.126017+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:37:03.126017+0000","last_undegraded":"2024-03-19T06:37:03.126017+0000","last_fullsized":"2024-03-19T06:37:03.126017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031845+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:38:37.031845+0000","last_peered":"2024-03-19T06:38:37.031845+0000","last_clean":"2024-03-19T06:38:37.031845+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:38:37.031845+0000","last_undegraded":"2024-03-19T06:38:37.031845+0000","last_fullsized":"2024-03-19T06:38:37.031845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'9","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.371952+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:38:05.371952+0000","last_peered":"2024-03-19T06:38:05.371952+0000","last_clean":"2024-03-19T06:38:05.371952+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:38:05.371952+0000","last_undegraded":"2024-03-19T06:38:05.371952+0000","last_fullsized":"2024-03-19T06:38:05.371952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'66","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.388054+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:37:05.388054+0000","last_peered":"2024-03-19T06:37:05.388054+0000","last_clean":"2024-03-19T06:37:05.388054+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:37:05.388054+0000","last_undegraded":"2024-03-19T06:37:05.388054+0000","last_fullsized":"2024-03-19T06:37:05.388054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173607+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:38:37.173607+0000","last_peered":"2024-03-19T06:38:37.173607+0000","last_clean":"2024-03-19T06:38:37.173607+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:38:37.173607+0000","last_undegraded":"2024-03-19T06:38:37.173607+0000","last_fullsized":"2024-03-19T06:38:37.173607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.964088+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:37:38.964088+0000","last_peered":"2024-03-19T06:37:38.964088+0000","last_clean":"2024-03-19T06:37:38.964088+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:37:38.964088+0000","last_undegraded":"2024-03-19T06:37:38.964088+0000","last_fullsized":"2024-03-19T06:37:38.964088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'429","reported_seq":474,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.066792+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:37:46.066792+0000","last_peered":"2024-03-19T06:37:46.066792+0000","last_clean":"2024-03-19T06:37:46.066792+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:37:46.066792+0000","last_undegraded":"2024-03-19T06:37:46.066792+0000","last_fullsized":"2024-03-19T06:37:46.066792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'23","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174549+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:38:37.174549+0000","last_peered":"2024-03-19T06:38:37.174549+0000","last_clean":"2024-03-19T06:38:37.174549+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:38:37.174549+0000","last_undegraded":"2024-03-19T06:38:37.174549+0000","last_fullsized":"2024-03-19T06:38:37.174549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'57","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.329186+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:37:14.329186+0000","last_peered":"2024-03-19T06:37:14.329186+0000","last_clean":"2024-03-19T06:37:14.329186+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:37:14.329186+0000","last_undegraded":"2024-03-19T06:37:14.329186+0000","last_fullsized":"2024-03-19T06:37:14.329186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'545","reported_seq":590,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.760870+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:38:10.760870+0000","last_peered":"2024-03-19T06:38:10.760870+0000","last_clean":"2024-03-19T06:38:10.760870+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:38:10.760870+0000","last_undegraded":"2024-03-19T06:38:10.760870+0000","last_fullsized":"2024-03-19T06:38:10.760870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.036645+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:38:37.036645+0000","last_peered":"2024-03-19T06:38:37.036645+0000","last_clean":"2024-03-19T06:38:37.036645+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:38:37.036645+0000","last_undegraded":"2024-03-19T06:38:37.036645+0000","last_fullsized":"2024-03-19T06:38:37.036645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:10.121030+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:37:10.121030+0000","last_peered":"2024-03-19T06:37:10.121030+0000","last_clean":"2024-03-19T06:37:10.121030+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:37:10.121030+0000","last_undegraded":"2024-03-19T06:37:10.121030+0000","last_fullsized":"2024-03-19T06:37:10.121030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'30","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266686+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:38:37.266686+0000","last_peered":"2024-03-19T06:38:37.266686+0000","last_clean":"2024-03-19T06:38:37.266686+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:38:37.266686+0000","last_undegraded":"2024-03-19T06:38:37.266686+0000","last_fullsized":"2024-03-19T06:38:37.266686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'25","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.117420+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:38:37.117420+0000","last_peered":"2024-03-19T06:38:37.117420+0000","last_clean":"2024-03-19T06:38:37.117420+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:38:37.117420+0000","last_undegraded":"2024-03-19T06:38:37.117420+0000","last_fullsized":"2024-03-19T06:38:37.117420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'25","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116203+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:38:37.116203+0000","last_peered":"2024-03-19T06:38:37.116203+0000","last_clean":"2024-03-19T06:38:37.116203+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:38:37.116203+0000","last_undegraded":"2024-03-19T06:38:37.116203+0000","last_fullsized":"2024-03-19T06:38:37.116203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174107+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:38:37.174107+0000","last_peered":"2024-03-19T06:38:37.174107+0000","last_clean":"2024-03-19T06:38:37.174107+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:38:37.174107+0000","last_undegraded":"2024-03-19T06:38:37.174107+0000","last_fullsized":"2024-03-19T06:38:37.174107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159101+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:38:37.159101+0000","last_peered":"2024-03-19T06:38:37.159101+0000","last_clean":"2024-03-19T06:38:37.159101+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:38:37.159101+0000","last_undegraded":"2024-03-19T06:38:37.159101+0000","last_fullsized":"2024-03-19T06:38:37.159101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030145+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:38:37.030145+0000","last_peered":"2024-03-19T06:38:37.030145+0000","last_clean":"2024-03-19T06:38:37.030145+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:38:37.030145+0000","last_undegraded":"2024-03-19T06:38:37.030145+0000","last_fullsized":"2024-03-19T06:38:37.030145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'34","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.268767+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:38:37.268767+0000","last_peered":"2024-03-19T06:38:37.268767+0000","last_clean":"2024-03-19T06:38:37.268767+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:38:37.268767+0000","last_undegraded":"2024-03-19T06:38:37.268767+0000","last_fullsized":"2024-03-19T06:38:37.268767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'15","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.157048+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:38:37.157048+0000","last_peered":"2024-03-19T06:38:37.157048+0000","last_clean":"2024-03-19T06:38:37.157048+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:38:37.157048+0000","last_undegraded":"2024-03-19T06:38:37.157048+0000","last_fullsized":"2024-03-19T06:38:37.157048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.024849+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:38:37.024849+0000","last_peered":"2024-03-19T06:38:37.024849+0000","last_clean":"2024-03-19T06:38:37.024849+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:38:37.024849+0000","last_undegraded":"2024-03-19T06:38:37.024849+0000","last_fullsized":"2024-03-19T06:38:37.024849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.156166+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:38:37.156166+0000","last_peered":"2024-03-19T06:38:37.156166+0000","last_clean":"2024-03-19T06:38:37.156166+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:38:37.156166+0000","last_undegraded":"2024-03-19T06:38:37.156166+0000","last_fullsized":"2024-03-19T06:38:37.156166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'24","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038453+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:38:37.038453+0000","last_peered":"2024-03-19T06:38:37.038453+0000","last_clean":"2024-03-19T06:38:37.038453+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:38:37.038453+0000","last_undegraded":"2024-03-19T06:38:37.038453+0000","last_fullsized":"2024-03-19T06:38:37.038453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174191+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:38:37.174191+0000","last_peered":"2024-03-19T06:38:37.174191+0000","last_clean":"2024-03-19T06:38:37.174191+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:38:37.174191+0000","last_undegraded":"2024-03-19T06:38:37.174191+0000","last_fullsized":"2024-03-19T06:38:37.174191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266242+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:38:37.266242+0000","last_peered":"2024-03-19T06:38:37.266242+0000","last_clean":"2024-03-19T06:38:37.266242+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:38:37.266242+0000","last_undegraded":"2024-03-19T06:38:37.266242+0000","last_fullsized":"2024-03-19T06:38:37.266242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.997271+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:38:36.997271+0000","last_peered":"2024-03-19T06:38:36.997271+0000","last_clean":"2024-03-19T06:38:36.997271+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:38:36.997271+0000","last_undegraded":"2024-03-19T06:38:36.997271+0000","last_fullsized":"2024-03-19T06:38:36.997271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.112896+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:38:37.112896+0000","last_peered":"2024-03-19T06:38:37.112896+0000","last_clean":"2024-03-19T06:38:37.112896+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:38:37.112896+0000","last_undegraded":"2024-03-19T06:38:37.112896+0000","last_fullsized":"2024-03-19T06:38:37.112896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.022733+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:38:37.022733+0000","last_peered":"2024-03-19T06:38:37.022733+0000","last_clean":"2024-03-19T06:38:37.022733+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:38:37.022733+0000","last_undegraded":"2024-03-19T06:38:37.022733+0000","last_fullsized":"2024-03-19T06:38:37.022733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.027476+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:38:37.027476+0000","last_peered":"2024-03-19T06:38:37.027476+0000","last_clean":"2024-03-19T06:38:37.027476+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:38:37.027476+0000","last_undegraded":"2024-03-19T06:38:37.027476+0000","last_fullsized":"2024-03-19T06:38:37.027476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.033006+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:38:37.033006+0000","last_peered":"2024-03-19T06:38:37.033006+0000","last_clean":"2024-03-19T06:38:37.033006+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:38:37.033006+0000","last_undegraded":"2024-03-19T06:38:37.033006+0000","last_fullsized":"2024-03-19T06:38:37.033006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173314+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:38:37.173314+0000","last_peered":"2024-03-19T06:38:37.173314+0000","last_clean":"2024-03-19T06:38:37.173314+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:38:37.173314+0000","last_undegraded":"2024-03-19T06:38:37.173314+0000","last_fullsized":"2024-03-19T06:38:37.173314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'33","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032462+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:38:37.032462+0000","last_peered":"2024-03-19T06:38:37.032462+0000","last_clean":"2024-03-19T06:38:37.032462+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:38:37.032462+0000","last_undegraded":"2024-03-19T06:38:37.032462+0000","last_fullsized":"2024-03-19T06:38:37.032462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037174+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:38:37.037174+0000","last_peered":"2024-03-19T06:38:37.037174+0000","last_clean":"2024-03-19T06:38:37.037174+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:38:37.037174+0000","last_undegraded":"2024-03-19T06:38:37.037174+0000","last_fullsized":"2024-03-19T06:38:37.037174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.261481+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:38:37.261481+0000","last_peered":"2024-03-19T06:38:37.261481+0000","last_clean":"2024-03-19T06:38:37.261481+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:38:37.261481+0000","last_undegraded":"2024-03-19T06:38:37.261481+0000","last_fullsized":"2024-03-19T06:38:37.261481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'31","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.269944+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:38:37.269944+0000","last_peered":"2024-03-19T06:38:37.269944+0000","last_clean":"2024-03-19T06:38:37.269944+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:38:37.269944+0000","last_undegraded":"2024-03-19T06:38:37.269944+0000","last_fullsized":"2024-03-19T06:38:37.269944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038936+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:38:37.038936+0000","last_peered":"2024-03-19T06:38:37.038936+0000","last_clean":"2024-03-19T06:38:37.038936+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:38:37.038936+0000","last_undegraded":"2024-03-19T06:38:37.038936+0000","last_fullsized":"2024-03-19T06:38:37.038936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160816+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:38:37.160816+0000","last_peered":"2024-03-19T06:38:37.160816+0000","last_clean":"2024-03-19T06:38:37.160816+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:38:37.160816+0000","last_undegraded":"2024-03-19T06:38:37.160816+0000","last_fullsized":"2024-03-19T06:38:37.160816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'17","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.985994+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:38:36.985994+0000","last_peered":"2024-03-19T06:38:36.985994+0000","last_clean":"2024-03-19T06:38:36.985994+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:38:36.985994+0000","last_undegraded":"2024-03-19T06:38:36.985994+0000","last_fullsized":"2024-03-19T06:38:36.985994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115360+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:38:37.115360+0000","last_peered":"2024-03-19T06:38:37.115360+0000","last_clean":"2024-03-19T06:38:37.115360+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:38:37.115360+0000","last_undegraded":"2024-03-19T06:38:37.115360+0000","last_fullsized":"2024-03-19T06:38:37.115360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.002299+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:38:37.002299+0000","last_peered":"2024-03-19T06:38:37.002299+0000","last_clean":"2024-03-19T06:38:37.002299+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:38:37.002299+0000","last_undegraded":"2024-03-19T06:38:37.002299+0000","last_fullsized":"2024-03-19T06:38:37.002299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.064056+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:38:37.064056+0000","last_peered":"2024-03-19T06:38:37.064056+0000","last_clean":"2024-03-19T06:38:37.064056+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:38:37.064056+0000","last_undegraded":"2024-03-19T06:38:37.064056+0000","last_fullsized":"2024-03-19T06:38:37.064056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'24","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.166927+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:38:37.166927+0000","last_peered":"2024-03-19T06:38:37.166927+0000","last_clean":"2024-03-19T06:38:37.166927+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:38:37.166927+0000","last_undegraded":"2024-03-19T06:38:37.166927+0000","last_fullsized":"2024-03-19T06:38:37.166927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.023949+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:38:37.023949+0000","last_peered":"2024-03-19T06:38:37.023949+0000","last_clean":"2024-03-19T06:38:37.023949+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:38:37.023949+0000","last_undegraded":"2024-03-19T06:38:37.023949+0000","last_fullsized":"2024-03-19T06:38:37.023949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115848+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:38:37.115848+0000","last_peered":"2024-03-19T06:38:37.115848+0000","last_clean":"2024-03-19T06:38:37.115848+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:38:37.115848+0000","last_undegraded":"2024-03-19T06:38:37.115848+0000","last_fullsized":"2024-03-19T06:38:37.115848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2145,"num_write_kb":250125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2307,"ondisk_log_size":2307,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1476,"ondisk_log_size":1476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22012001,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":7122,"num_write_kb":24983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44269568,"data_stored":44024002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5503,"ondisk_log_size":5503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477132,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":13553664,"data_stored":13317561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719477131,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39876,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331964,"statfs":{"total":96636764160,"available":96595931136,"internally_reserved":0,"allocated":389120,"data_stored":146113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477130,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":8753152,"data_stored":8532119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477130,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":9564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":9793536,"data_stored":9563850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509835,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39724,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332116,"statfs":{"total":96636764160,"available":96596086784,"internally_reserved":0,"allocated":8753152,"data_stored":8532251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509834,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":260592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509834,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":143131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509834,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":5932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":6074368,"data_stored":5841620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5140480,"data_stored":5109729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":119134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9422327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:38:43.886 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:38:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.167+0000 7f1b89a00640 1 Processor -- start 2024-03-19T06:38:44.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.167+0000 7f1b89a00640 1 -- start start 2024-03-19T06:38:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.169+0000 7f1b89a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 0x7f1b840caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.169+0000 7f1b89a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b840cb400 0x7f1b840ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.169+0000 7f1b89a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b84154270 con 0x7f1b840ca610 2024-03-19T06:38:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.169+0000 7f1b89a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b84159cd0 con 0x7f1b840cb400 2024-03-19T06:38:44.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.169+0000 7f1b89a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84159fb0 con 0x7f1b84153e90 2024-03-19T06:38:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.170+0000 7f1b89000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1b840ca610 0x7f1b8415d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38714/0 (socket says 172.21.15.17:38714) 2024-03-19T06:38:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.170+0000 7f1b89000640 1 -- 172.21.15.17:0/1842450233 learned_addr learned my addr 172.21.15.17:0/1842450233 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:44.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.171+0000 7f1b83400640 1 --2- 172.21.15.17:0/1842450233 >> v2:172.21.15.153:3300/0 conn(0x7f1b840cb400 0x7f1b840ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.171+0000 7f1b83e00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 0x7f1b840caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.173+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374681022 0 0) 0x7f1b7c001490 con 0x7f1b840ca610 2024-03-19T06:38:44.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.173+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b68003520 con 0x7f1b840ca610 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.177+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2915940669 0 0) 0x7f1b68003520 con 0x7f1b840ca610 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.177+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 msgr2=0x7f1b840caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.177+0000 7f1b82a00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 0x7f1b840caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.177+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 >> v2:172.21.15.153:3300/0 conn(0x7f1b840cb400 msgr2=0x7f1b840ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.177+0000 7f1b82a00640 1 --2- 172.21.15.17:0/1842450233 >> v2:172.21.15.153:3300/0 conn(0x7f1b840cb400 0x7f1b840ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8415a290 con 0x7f1b840ca610 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f1b7c001bc0 con 0x7f1b840ca610 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 >> v1:172.21.15.17:6789/0 conn(0x7f1b840ca610 legacy=0x7f1b8415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b680039b0 0x7f1b68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 0x7f1b68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b68004d40 0x7f1b680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84159cd0 con 0x7f1b68004d40 2024-03-19T06:38:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84159fb0 con 0x7f1b680039b0 2024-03-19T06:38:44.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.178+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6800b9c0 con 0x7f1b84153e90 2024-03-19T06:38:44.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.182+0000 7f1b89000640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b68004d40 0x7f1b680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.185+0000 7f1b89000640 1 -- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 msgr2=0x7f1b68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.185+0000 7f1b89000640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b84153e90 0x7f1b68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.185+0000 7f1b89000640 1 -- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b680039b0 msgr2=0x7f1b68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:44.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.185+0000 7f1b89000640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b680039b0 0x7f1b68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.185+0000 7f1b89000640 1 -- 172.21.15.17:0/1842450233 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b68003520 con 0x7f1b68004d40 2024-03-19T06:38:44.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.188+0000 7f1b89000640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b68004d40 0x7f1b680051c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00a9a0 tx=0x7f1b68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f54a69d1fbc8ce2 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.193+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00a5c0 con 0x7f1b68004d40 2024-03-19T06:38:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.193+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c035420 con 0x7f1b68004d40 2024-03-19T06:38:44.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.193+0000 7f1b82a00640 1 -- 172.21.15.17:0/1842450233 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c035830 con 0x7f1b68004d40 2024-03-19T06:38:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.194+0000 7f1b89a00640 1 -- 172.21.15.17:0/1842450233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b68004d40 msgr2=0x7f1b680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.194+0000 7f1b89a00640 1 --2- 172.21.15.17:0/1842450233 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b68004d40 0x7f1b680051c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00a9a0 tx=0x7f1b68005830 comp rx=0 tx=0).stop 2024-03-19T06:38:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.194+0000 7f1b89000640 1 -- 172.21.15.17:0/1842450233 reap_dead start 2024-03-19T06:38:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.194+0000 7f1b89a00640 1 -- 172.21.15.17:0/1842450233 shutdown_connections 2024-03-19T06:38:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.194+0000 7f1b89a00640 1 -- 172.21.15.17:0/1842450233 >> 172.21.15.17:0/1842450233 conn(0x7f1b8406b540 msgr2=0x7f1b8406b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.195+0000 7f1b89a00640 1 -- 172.21.15.17:0/1842450233 shutdown_connections 2024-03-19T06:38:44.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.195+0000 7f1b89a00640 1 -- 172.21.15.17:0/1842450233 wait complete. 2024-03-19T06:38:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.198+0000 7f1b89a00640 1 Processor -- start 2024-03-19T06:38:44.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.198+0000 7f1b89a00640 1 -- start start 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68004d40 0x7f1b841e5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b840cf110 0x7f1b84158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840c6750 con 0x7f1b84158f60 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8415a850 con 0x7f1b840cf110 2024-03-19T06:38:44.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.200+0000 7f1b89a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840b5120 con 0x7f1b68004d40 2024-03-19T06:38:44.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.201+0000 7f1b89000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.201+0000 7f1b89000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60354/0 (socket says 172.21.15.17:60354) 2024-03-19T06:38:44.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.201+0000 7f1b89000640 1 -- 172.21.15.17:0/2911568063 learned_addr learned my addr 172.21.15.17:0/2911568063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:44.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.203+0000 7f1b83400640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b840cf110 0x7f1b84158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.204+0000 7f1b83e00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68004d40 0x7f1b841e5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.207+0000 7f1b89000640 1 -- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68004d40 msgr2=0x7f1b841e5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.207+0000 7f1b89000640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68004d40 0x7f1b841e5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.207+0000 7f1b89000640 1 -- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b840cf110 msgr2=0x7f1b84158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.207+0000 7f1b89000640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b840cf110 0x7f1b84158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.207+0000 7f1b89000640 1 -- 172.21.15.17:0/2911568063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84159a60 con 0x7f1b84158f60 2024-03-19T06:38:44.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.212+0000 7f1b89000640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00aa90 tx=0x7f1b840c60a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.216+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c044070 con 0x7f1b84158f60 2024-03-19T06:38:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.216+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c004b60 con 0x7f1b84158f60 2024-03-19T06:38:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.216+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c03a040 con 0x7f1b84158f60 2024-03-19T06:38:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.216+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b840cf590 con 0x7f1b84158f60 2024-03-19T06:38:44.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.216+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8415ca50 con 0x7f1b84158f60 2024-03-19T06:38:44.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.217+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84158720 con 0x7f1b84158f60 2024-03-19T06:38:44.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.248+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1b7c047070 con 0x7f1b84158f60 2024-03-19T06:38:44.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.250+0000 7f1b7be00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 0x7f1b6406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:44.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.251+0000 7f1b83e00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 0x7f1b6406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:44.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.252+0000 7f1b83e00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 0x7f1b6406e0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b74004770 tx=0x7f1b74006a20 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:44.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.565+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1b7c078630 con 0x7f1b84158f60 2024-03-19T06:38:44.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.566+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f1b84158720 con 0x7f1b84158f60 2024-03-19T06:38:44.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.783+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b840caca0 con 0x7f1b6406bc00 2024-03-19T06:38:44.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.795+0000 7f1b7be00640 1 -- 172.21.15.17:0/2911568063 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+333458 (secure 0 0 0) 0x7f1b840caca0 con 0x7f1b6406bc00 2024-03-19T06:38:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:44.786 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:38:44.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 msgr2=0x7f1b6406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 0x7f1b6406e0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b74004770 tx=0x7f1b74006a20 comp rx=0 tx=0).stop 2024-03-19T06:38:44.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 msgr2=0x7f1b8414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:44.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00aa90 tx=0x7f1b840c60a0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 shutdown_connections 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b84158f60 0x7f1b8414a530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1b6406bc00 0x7f1b6406e0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b840cf110 0x7f1b84158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 --2- 172.21.15.17:0/2911568063 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1b68004d40 0x7f1b841e5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 >> 172.21.15.17:0/2911568063 conn(0x7f1b8406b540 msgr2=0x7f1b840c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 shutdown_connections 2024-03-19T06:38:44.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:44.803+0000 7f1b89a00640 1 -- 172.21.15.17:0/2911568063 wait complete. 2024-03-19T06:38:44.809 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":1002,"stamp":"2024-03-19T06:38:44.246534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22602369,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":597,"num_read_kb":611,"num_write":9426,"num_write_kb":277524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317256,"kb_used_data":47048,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657464,"statfs":{"total":773094113280,"available":772769243136,"internally_reserved":0,"allocated":48177152,"data_stored":46337530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12157,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004910"},"pg_stats":[{"pgid":"2.1f","version":"32'658","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.067199+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:37:46.067199+0000","last_peered":"2024-03-19T06:37:46.067199+0000","last_clean":"2024-03-19T06:37:46.067199+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:37:46.067199+0000","last_undegraded":"2024-03-19T06:37:46.067199+0000","last_fullsized":"2024-03-19T06:37:46.067199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.154376+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:38:37.154376+0000","last_peered":"2024-03-19T06:38:37.154376+0000","last_clean":"2024-03-19T06:38:37.154376+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:38:37.154376+0000","last_undegraded":"2024-03-19T06:38:37.154376+0000","last_fullsized":"2024-03-19T06:38:37.154376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'60","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.594249+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:37:15.594249+0000","last_peered":"2024-03-19T06:37:15.594249+0000","last_clean":"2024-03-19T06:37:15.594249+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:37:15.594249+0000","last_undegraded":"2024-03-19T06:37:15.594249+0000","last_fullsized":"2024-03-19T06:37:15.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'93","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.466869+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:38:37.466869+0000","last_peered":"2024-03-19T06:38:37.466869+0000","last_clean":"2024-03-19T06:38:37.466869+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:38:37.466869+0000","last_undegraded":"2024-03-19T06:38:37.466869+0000","last_fullsized":"2024-03-19T06:38:37.466869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":914551,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171494+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:38:37.171494+0000","last_peered":"2024-03-19T06:38:37.171494+0000","last_clean":"2024-03-19T06:38:37.171494+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:38:37.171494+0000","last_undegraded":"2024-03-19T06:38:37.171494+0000","last_fullsized":"2024-03-19T06:38:37.171494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'63","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:55.649400+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:36:55.649400+0000","last_peered":"2024-03-19T06:36:55.649400+0000","last_clean":"2024-03-19T06:36:55.649400+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:36:55.649400+0000","last_undegraded":"2024-03-19T06:36:55.649400+0000","last_fullsized":"2024-03-19T06:36:55.649400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.779829+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:38:11.779829+0000","last_peered":"2024-03-19T06:38:11.779829+0000","last_clean":"2024-03-19T06:38:11.779829+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:38:11.779829+0000","last_undegraded":"2024-03-19T06:38:11.779829+0000","last_fullsized":"2024-03-19T06:38:11.779829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085166+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:38:37.085166+0000","last_peered":"2024-03-19T06:38:37.085166+0000","last_clean":"2024-03-19T06:38:37.085166+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:38:37.085166+0000","last_undegraded":"2024-03-19T06:38:37.085166+0000","last_fullsized":"2024-03-19T06:38:37.085166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'72","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.947835+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:37:12.947835+0000","last_peered":"2024-03-19T06:37:12.947835+0000","last_clean":"2024-03-19T06:37:12.947835+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:37:12.947835+0000","last_undegraded":"2024-03-19T06:37:12.947835+0000","last_fullsized":"2024-03-19T06:37:12.947835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:33.116946+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:36:33.116946+0000","last_peered":"2024-03-19T06:36:33.116946+0000","last_clean":"2024-03-19T06:36:33.116946+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:36:33.116946+0000","last_undegraded":"2024-03-19T06:36:33.116946+0000","last_fullsized":"2024-03-19T06:36:33.116946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038109+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:38:37.038109+0000","last_peered":"2024-03-19T06:38:37.038109+0000","last_clean":"2024-03-19T06:38:37.038109+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:38:37.038109+0000","last_undegraded":"2024-03-19T06:38:37.038109+0000","last_fullsized":"2024-03-19T06:38:37.038109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.839487+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:37:17.839487+0000","last_peered":"2024-03-19T06:37:17.839487+0000","last_clean":"2024-03-19T06:37:17.839487+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:37:17.839487+0000","last_undegraded":"2024-03-19T06:37:17.839487+0000","last_fullsized":"2024-03-19T06:37:17.839487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266186+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:38:37.266186+0000","last_peered":"2024-03-19T06:38:37.266186+0000","last_clean":"2024-03-19T06:38:37.266186+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:38:37.266186+0000","last_undegraded":"2024-03-19T06:38:37.266186+0000","last_fullsized":"2024-03-19T06:38:37.266186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'679","reported_seq":726,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:03.132901+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:38:03.132901+0000","last_peered":"2024-03-19T06:38:03.132901+0000","last_clean":"2024-03-19T06:38:03.132901+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:38:03.132901+0000","last_undegraded":"2024-03-19T06:38:03.132901+0000","last_fullsized":"2024-03-19T06:38:03.132901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'61","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.740237+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:37:19.740237+0000","last_peered":"2024-03-19T06:37:19.740237+0000","last_clean":"2024-03-19T06:37:19.740237+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:37:19.740237+0000","last_undegraded":"2024-03-19T06:37:19.740237+0000","last_fullsized":"2024-03-19T06:37:19.740237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173890+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:38:37.173890+0000","last_peered":"2024-03-19T06:38:37.173890+0000","last_clean":"2024-03-19T06:38:37.173890+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:38:37.173890+0000","last_undegraded":"2024-03-19T06:38:37.173890+0000","last_fullsized":"2024-03-19T06:38:37.173890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:51.658227+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:37:51.658227+0000","last_peered":"2024-03-19T06:37:51.658227+0000","last_clean":"2024-03-19T06:37:51.658227+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:37:51.658227+0000","last_undegraded":"2024-03-19T06:37:51.658227+0000","last_fullsized":"2024-03-19T06:37:51.658227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'90","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.611055+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:37:19.611055+0000","last_peered":"2024-03-19T06:37:19.611055+0000","last_clean":"2024-03-19T06:37:19.611055+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:37:19.611055+0000","last_undegraded":"2024-03-19T06:37:19.611055+0000","last_fullsized":"2024-03-19T06:37:19.611055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":8470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159403+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:38:37.159403+0000","last_peered":"2024-03-19T06:38:37.159403+0000","last_clean":"2024-03-19T06:38:37.159403+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:38:37.159403+0000","last_undegraded":"2024-03-19T06:38:37.159403+0000","last_fullsized":"2024-03-19T06:38:37.159403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:31.382833+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:37:31.382833+0000","last_peered":"2024-03-19T06:37:31.382833+0000","last_clean":"2024-03-19T06:37:31.382833+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:37:31.382833+0000","last_undegraded":"2024-03-19T06:37:31.382833+0000","last_fullsized":"2024-03-19T06:37:31.382833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'65","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.616840+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:37:15.616840+0000","last_peered":"2024-03-19T06:37:15.616840+0000","last_clean":"2024-03-19T06:37:15.616840+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:37:15.616840+0000","last_undegraded":"2024-03-19T06:37:15.616840+0000","last_fullsized":"2024-03-19T06:37:15.616840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":11230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.509408+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:37:18.509408+0000","last_peered":"2024-03-19T06:37:18.509408+0000","last_clean":"2024-03-19T06:37:18.509408+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:37:18.509408+0000","last_undegraded":"2024-03-19T06:37:18.509408+0000","last_fullsized":"2024-03-19T06:37:18.509408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'9","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.838516+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:38:10.838516+0000","last_peered":"2024-03-19T06:38:10.838516+0000","last_clean":"2024-03-19T06:38:10.838516+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:38:10.838516+0000","last_undegraded":"2024-03-19T06:38:10.838516+0000","last_fullsized":"2024-03-19T06:38:10.838516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'67","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.511740+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:37:18.511740+0000","last_peered":"2024-03-19T06:37:18.511740+0000","last_clean":"2024-03-19T06:37:18.511740+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:37:18.511740+0000","last_undegraded":"2024-03-19T06:37:18.511740+0000","last_fullsized":"2024-03-19T06:37:18.511740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'28","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173332+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:38:37.173332+0000","last_peered":"2024-03-19T06:38:37.173332+0000","last_clean":"2024-03-19T06:38:37.173332+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:38:37.173332+0000","last_undegraded":"2024-03-19T06:38:37.173332+0000","last_fullsized":"2024-03-19T06:38:37.173332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.763816+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:38:11.763816+0000","last_peered":"2024-03-19T06:38:11.763816+0000","last_clean":"2024-03-19T06:38:11.763816+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:38:11.763816+0000","last_undegraded":"2024-03-19T06:38:11.763816+0000","last_fullsized":"2024-03-19T06:38:11.763816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'50","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.829685+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:37:17.829685+0000","last_peered":"2024-03-19T06:37:17.829685+0000","last_clean":"2024-03-19T06:37:17.829685+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:37:17.829685+0000","last_undegraded":"2024-03-19T06:37:17.829685+0000","last_fullsized":"2024-03-19T06:37:17.829685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160467+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:38:37.160467+0000","last_peered":"2024-03-19T06:38:37.160467+0000","last_clean":"2024-03-19T06:38:37.160467+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:38:37.160467+0000","last_undegraded":"2024-03-19T06:38:37.160467+0000","last_fullsized":"2024-03-19T06:38:37.160467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'1210","reported_seq":1257,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:29.328934+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:38:29.328934+0000","last_peered":"2024-03-19T06:38:29.328934+0000","last_clean":"2024-03-19T06:38:29.328934+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:38:29.328934+0000","last_undegraded":"2024-03-19T06:38:29.328934+0000","last_fullsized":"2024-03-19T06:38:29.328934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'85","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.611281+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:37:14.611281+0000","last_peered":"2024-03-19T06:37:14.611281+0000","last_clean":"2024-03-19T06:37:14.611281+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:37:14.611281+0000","last_undegraded":"2024-03-19T06:37:14.611281+0000","last_fullsized":"2024-03-19T06:37:14.611281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":11129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030046+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:38:37.030046+0000","last_peered":"2024-03-19T06:38:37.030046+0000","last_clean":"2024-03-19T06:38:37.030046+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:38:37.030046+0000","last_undegraded":"2024-03-19T06:38:37.030046+0000","last_fullsized":"2024-03-19T06:38:37.030046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:53.131139+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:37:53.131139+0000","last_peered":"2024-03-19T06:37:53.131139+0000","last_clean":"2024-03-19T06:37:53.131139+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:37:53.131139+0000","last_undegraded":"2024-03-19T06:37:53.131139+0000","last_fullsized":"2024-03-19T06:37:53.131139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'48","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.734172+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:37:19.734172+0000","last_peered":"2024-03-19T06:37:19.734172+0000","last_clean":"2024-03-19T06:37:19.734172+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:37:19.734172+0000","last_undegraded":"2024-03-19T06:37:19.734172+0000","last_fullsized":"2024-03-19T06:37:19.734172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":5603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026364+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:38:37.026364+0000","last_peered":"2024-03-19T06:38:37.026364+0000","last_clean":"2024-03-19T06:38:37.026364+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:38:37.026364+0000","last_undegraded":"2024-03-19T06:38:37.026364+0000","last_fullsized":"2024-03-19T06:38:37.026364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:47.292216+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:37:47.292216+0000","last_peered":"2024-03-19T06:37:47.292216+0000","last_clean":"2024-03-19T06:37:47.292216+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:37:47.292216+0000","last_undegraded":"2024-03-19T06:37:47.292216+0000","last_fullsized":"2024-03-19T06:37:47.292216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'69","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.597812+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:37:14.597812+0000","last_peered":"2024-03-19T06:37:14.597812+0000","last_clean":"2024-03-19T06:37:14.597812+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:37:14.597812+0000","last_undegraded":"2024-03-19T06:37:14.597812+0000","last_fullsized":"2024-03-19T06:37:14.597812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026235+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:38:37.026235+0000","last_peered":"2024-03-19T06:38:37.026235+0000","last_clean":"2024-03-19T06:38:37.026235+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:38:37.026235+0000","last_undegraded":"2024-03-19T06:38:37.026235+0000","last_fullsized":"2024-03-19T06:38:37.026235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.337649+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:38:20.337649+0000","last_peered":"2024-03-19T06:38:20.337649+0000","last_clean":"2024-03-19T06:38:20.337649+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:38:20.337649+0000","last_undegraded":"2024-03-19T06:38:20.337649+0000","last_fullsized":"2024-03-19T06:38:20.337649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'57","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.743175+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:37:19.743175+0000","last_peered":"2024-03-19T06:37:19.743175+0000","last_clean":"2024-03-19T06:37:19.743175+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:37:19.743175+0000","last_undegraded":"2024-03-19T06:37:19.743175+0000","last_fullsized":"2024-03-19T06:37:19.743175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'24","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031677+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:38:37.031677+0000","last_peered":"2024-03-19T06:38:37.031677+0000","last_clean":"2024-03-19T06:38:37.031677+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:38:37.031677+0000","last_undegraded":"2024-03-19T06:38:37.031677+0000","last_fullsized":"2024-03-19T06:38:37.031677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'498","reported_seq":1027,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:25.505665+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:38:25.505665+0000","last_peered":"2024-03-19T06:38:25.505665+0000","last_clean":"2024-03-19T06:38:25.505665+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:38:25.505665+0000","last_undegraded":"2024-03-19T06:38:25.505665+0000","last_fullsized":"2024-03-19T06:38:25.505665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117202,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":494,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'60","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618658+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:37:15.618658+0000","last_peered":"2024-03-19T06:37:15.618658+0000","last_clean":"2024-03-19T06:37:15.618658+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:37:15.618658+0000","last_undegraded":"2024-03-19T06:37:15.618658+0000","last_fullsized":"2024-03-19T06:37:15.618658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'13","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.167195+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:38:37.167195+0000","last_peered":"2024-03-19T06:38:37.167195+0000","last_clean":"2024-03-19T06:38:37.167195+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:38:37.167195+0000","last_undegraded":"2024-03-19T06:38:37.167195+0000","last_fullsized":"2024-03-19T06:38:37.167195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:23.529286+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:38:23.529286+0000","last_peered":"2024-03-19T06:38:23.529286+0000","last_clean":"2024-03-19T06:38:23.529286+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:38:23.529286+0000","last_undegraded":"2024-03-19T06:38:23.529286+0000","last_fullsized":"2024-03-19T06:38:23.529286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'93","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.098216+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:37:17.098216+0000","last_peered":"2024-03-19T06:37:17.098216+0000","last_clean":"2024-03-19T06:37:17.098216+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:37:17.098216+0000","last_undegraded":"2024-03-19T06:37:17.098216+0000","last_fullsized":"2024-03-19T06:37:17.098216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.153982+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:38:37.153982+0000","last_peered":"2024-03-19T06:38:37.153982+0000","last_clean":"2024-03-19T06:38:37.153982+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:38:37.153982+0000","last_undegraded":"2024-03-19T06:38:37.153982+0000","last_fullsized":"2024-03-19T06:38:37.153982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'11","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.348283+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:38:20.348283+0000","last_peered":"2024-03-19T06:38:20.348283+0000","last_clean":"2024-03-19T06:38:20.348283+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:38:20.348283+0000","last_undegraded":"2024-03-19T06:38:20.348283+0000","last_fullsized":"2024-03-19T06:38:20.348283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:18.113959+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:36:18.113959+0000","last_peered":"2024-03-19T06:36:18.113959+0000","last_clean":"2024-03-19T06:36:18.113959+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:36:18.113959+0000","last_undegraded":"2024-03-19T06:36:18.113959+0000","last_fullsized":"2024-03-19T06:36:18.113959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'67","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.095497+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:37:17.095497+0000","last_peered":"2024-03-19T06:37:17.095497+0000","last_clean":"2024-03-19T06:37:17.095497+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:37:17.095497+0000","last_undegraded":"2024-03-19T06:37:17.095497+0000","last_fullsized":"2024-03-19T06:37:17.095497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087488+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:38:37.087488+0000","last_peered":"2024-03-19T06:38:37.087488+0000","last_clean":"2024-03-19T06:38:37.087488+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:38:37.087488+0000","last_undegraded":"2024-03-19T06:38:37.087488+0000","last_fullsized":"2024-03-19T06:38:37.087488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:02.268841+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:38:02.268841+0000","last_peered":"2024-03-19T06:38:02.268841+0000","last_clean":"2024-03-19T06:38:02.268841+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:38:02.268841+0000","last_undegraded":"2024-03-19T06:38:02.268841+0000","last_fullsized":"2024-03-19T06:38:02.268841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'77","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:07.191063+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:37:07.191063+0000","last_peered":"2024-03-19T06:37:07.191063+0000","last_clean":"2024-03-19T06:37:07.191063+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:37:07.191063+0000","last_undegraded":"2024-03-19T06:37:07.191063+0000","last_fullsized":"2024-03-19T06:37:07.191063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.020683+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:38:37.020683+0000","last_peered":"2024-03-19T06:38:37.020683+0000","last_clean":"2024-03-19T06:38:37.020683+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:38:37.020683+0000","last_undegraded":"2024-03-19T06:38:37.020683+0000","last_fullsized":"2024-03-19T06:38:37.020683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.370830+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:38:05.370830+0000","last_peered":"2024-03-19T06:38:05.370830+0000","last_clean":"2024-03-19T06:38:05.370830+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:38:05.370830+0000","last_undegraded":"2024-03-19T06:38:05.370830+0000","last_fullsized":"2024-03-19T06:38:05.370830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'101","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.547085+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:37:18.547085+0000","last_peered":"2024-03-19T06:37:18.547085+0000","last_clean":"2024-03-19T06:37:18.547085+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:37:18.547085+0000","last_undegraded":"2024-03-19T06:37:18.547085+0000","last_fullsized":"2024-03-19T06:37:18.547085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":8077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087400+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:38:37.087400+0000","last_peered":"2024-03-19T06:38:37.087400+0000","last_clean":"2024-03-19T06:38:37.087400+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:38:37.087400+0000","last_undegraded":"2024-03-19T06:38:37.087400+0000","last_fullsized":"2024-03-19T06:38:37.087400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.963636+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:37:38.963636+0000","last_peered":"2024-03-19T06:37:38.963636+0000","last_clean":"2024-03-19T06:37:38.963636+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:37:38.963636+0000","last_undegraded":"2024-03-19T06:37:38.963636+0000","last_fullsized":"2024-03-19T06:37:38.963636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'66","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.569020+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:37:12.569020+0000","last_peered":"2024-03-19T06:37:12.569020+0000","last_clean":"2024-03-19T06:37:12.569020+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:37:12.569020+0000","last_undegraded":"2024-03-19T06:37:12.569020+0000","last_fullsized":"2024-03-19T06:37:12.569020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'16","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032178+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:38:37.032178+0000","last_peered":"2024-03-19T06:38:37.032178+0000","last_clean":"2024-03-19T06:38:37.032178+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:38:37.032178+0000","last_undegraded":"2024-03-19T06:38:37.032178+0000","last_fullsized":"2024-03-19T06:38:37.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.047495+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:38:16.047495+0000","last_peered":"2024-03-19T06:38:16.047495+0000","last_clean":"2024-03-19T06:38:16.047495+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:38:16.047495+0000","last_undegraded":"2024-03-19T06:38:16.047495+0000","last_fullsized":"2024-03-19T06:38:16.047495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'94","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.007381+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:37:17.007381+0000","last_peered":"2024-03-19T06:37:17.007381+0000","last_clean":"2024-03-19T06:37:17.007381+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:37:17.007381+0000","last_undegraded":"2024-03-19T06:37:17.007381+0000","last_fullsized":"2024-03-19T06:37:17.007381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'23","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.029144+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:38:37.029144+0000","last_peered":"2024-03-19T06:38:37.029144+0000","last_clean":"2024-03-19T06:38:37.029144+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:38:37.029144+0000","last_undegraded":"2024-03-19T06:38:37.029144+0000","last_fullsized":"2024-03-19T06:38:37.029144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:42.862515+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:37:42.862515+0000","last_peered":"2024-03-19T06:37:42.862515+0000","last_clean":"2024-03-19T06:37:42.862515+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:37:42.862515+0000","last_undegraded":"2024-03-19T06:37:42.862515+0000","last_fullsized":"2024-03-19T06:37:42.862515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'78","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.504900+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:37:15.504900+0000","last_peered":"2024-03-19T06:37:15.504900+0000","last_clean":"2024-03-19T06:37:15.504900+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:37:15.504900+0000","last_undegraded":"2024-03-19T06:37:15.504900+0000","last_fullsized":"2024-03-19T06:37:15.504900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.255304+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:38:37.255304+0000","last_peered":"2024-03-19T06:38:37.255304+0000","last_clean":"2024-03-19T06:38:37.255304+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:38:37.255304+0000","last_undegraded":"2024-03-19T06:38:37.255304+0000","last_fullsized":"2024-03-19T06:38:37.255304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:52.188328+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:36:52.188328+0000","last_peered":"2024-03-19T06:36:52.188328+0000","last_clean":"2024-03-19T06:36:52.188328+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:36:52.188328+0000","last_undegraded":"2024-03-19T06:36:52.188328+0000","last_fullsized":"2024-03-19T06:36:52.188328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'70","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.601649+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:37:19.601649+0000","last_peered":"2024-03-19T06:37:19.601649+0000","last_clean":"2024-03-19T06:37:19.601649+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:37:19.601649+0000","last_undegraded":"2024-03-19T06:37:19.601649+0000","last_fullsized":"2024-03-19T06:37:19.601649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'36","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.089634+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:38:37.089634+0000","last_peered":"2024-03-19T06:38:37.089634+0000","last_clean":"2024-03-19T06:38:37.089634+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:38:37.089634+0000","last_undegraded":"2024-03-19T06:38:37.089634+0000","last_fullsized":"2024-03-19T06:38:37.089634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:17.098272+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:38:17.098272+0000","last_peered":"2024-03-19T06:38:17.098272+0000","last_clean":"2024-03-19T06:38:17.098272+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:38:17.098272+0000","last_undegraded":"2024-03-19T06:38:17.098272+0000","last_fullsized":"2024-03-19T06:38:17.098272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.589025+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:37:05.589025+0000","last_peered":"2024-03-19T06:37:05.589025+0000","last_clean":"2024-03-19T06:37:05.589025+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:37:05.589025+0000","last_undegraded":"2024-03-19T06:37:05.589025+0000","last_fullsized":"2024-03-19T06:37:05.589025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.170926+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:38:37.170926+0000","last_peered":"2024-03-19T06:38:37.170926+0000","last_clean":"2024-03-19T06:38:37.170926+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:38:37.170926+0000","last_undegraded":"2024-03-19T06:38:37.170926+0000","last_fullsized":"2024-03-19T06:38:37.170926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:34:32.448275+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:34:32.448275+0000","last_peered":"2024-03-19T06:34:32.448275+0000","last_clean":"2024-03-19T06:34:32.448275+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:34:32.448275+0000","last_undegraded":"2024-03-19T06:34:32.448275+0000","last_fullsized":"2024-03-19T06:34:32.448275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'61","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.735140+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:37:17.735140+0000","last_peered":"2024-03-19T06:37:17.735140+0000","last_clean":"2024-03-19T06:37:17.735140+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:37:17.735140+0000","last_undegraded":"2024-03-19T06:37:17.735140+0000","last_fullsized":"2024-03-19T06:37:17.735140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'18","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.021602+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:38:37.021602+0000","last_peered":"2024-03-19T06:38:37.021602+0000","last_clean":"2024-03-19T06:38:37.021602+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:38:37.021602+0000","last_undegraded":"2024-03-19T06:38:37.021602+0000","last_fullsized":"2024-03-19T06:38:37.021602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'840","reported_seq":886,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.113886+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:38:16.113886+0000","last_peered":"2024-03-19T06:38:16.113886+0000","last_clean":"2024-03-19T06:38:16.113886+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:38:16.113886+0000","last_undegraded":"2024-03-19T06:38:16.113886+0000","last_fullsized":"2024-03-19T06:38:16.113886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'84","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618484+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:37:15.618484+0000","last_peered":"2024-03-19T06:37:15.618484+0000","last_clean":"2024-03-19T06:37:15.618484+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:37:15.618484+0000","last_undegraded":"2024-03-19T06:37:15.618484+0000","last_fullsized":"2024-03-19T06:37:15.618484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":13735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'24","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037016+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:38:37.037016+0000","last_peered":"2024-03-19T06:38:37.037016+0000","last_clean":"2024-03-19T06:38:37.037016+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:38:37.037016+0000","last_undegraded":"2024-03-19T06:38:37.037016+0000","last_fullsized":"2024-03-19T06:38:37.037016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'333","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:24.527850+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:38:24.527850+0000","last_peered":"2024-03-19T06:38:24.527850+0000","last_clean":"2024-03-19T06:38:24.527850+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:38:24.527850+0000","last_undegraded":"2024-03-19T06:38:24.527850+0000","last_fullsized":"2024-03-19T06:38:24.527850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'115","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.249693+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:37:03.249693+0000","last_peered":"2024-03-19T06:37:03.249693+0000","last_clean":"2024-03-19T06:37:03.249693+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:37:03.249693+0000","last_undegraded":"2024-03-19T06:37:03.249693+0000","last_fullsized":"2024-03-19T06:37:03.249693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":11739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'25","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171351+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:38:37.171351+0000","last_peered":"2024-03-19T06:38:37.171351+0000","last_clean":"2024-03-19T06:38:37.171351+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:38:37.171351+0000","last_undegraded":"2024-03-19T06:38:37.171351+0000","last_fullsized":"2024-03-19T06:38:37.171351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:06.360670+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:38:06.360670+0000","last_peered":"2024-03-19T06:38:06.360670+0000","last_clean":"2024-03-19T06:38:06.360670+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:38:06.360670+0000","last_undegraded":"2024-03-19T06:38:06.360670+0000","last_fullsized":"2024-03-19T06:38:06.360670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'77","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:06.179460+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:37:06.179460+0000","last_peered":"2024-03-19T06:37:06.179460+0000","last_clean":"2024-03-19T06:37:06.179460+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:37:06.179460+0000","last_undegraded":"2024-03-19T06:37:06.179460+0000","last_fullsized":"2024-03-19T06:37:06.179460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.063076+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:38:37.063076+0000","last_peered":"2024-03-19T06:38:37.063076+0000","last_clean":"2024-03-19T06:38:37.063076+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:38:37.063076+0000","last_undegraded":"2024-03-19T06:38:37.063076+0000","last_fullsized":"2024-03-19T06:38:37.063076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.662309+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:38:36.662309+0000","last_peered":"2024-03-19T06:38:36.662309+0000","last_clean":"2024-03-19T06:38:36.662309+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:38:36.662309+0000","last_undegraded":"2024-03-19T06:38:36.662309+0000","last_fullsized":"2024-03-19T06:38:36.662309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'86","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.001662+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:37:17.001662+0000","last_peered":"2024-03-19T06:37:17.001662+0000","last_clean":"2024-03-19T06:37:17.001662+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:37:17.001662+0000","last_undegraded":"2024-03-19T06:37:17.001662+0000","last_fullsized":"2024-03-19T06:37:17.001662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":9535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'52","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.126017+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:37:03.126017+0000","last_peered":"2024-03-19T06:37:03.126017+0000","last_clean":"2024-03-19T06:37:03.126017+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:37:03.126017+0000","last_undegraded":"2024-03-19T06:37:03.126017+0000","last_fullsized":"2024-03-19T06:37:03.126017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031845+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:38:37.031845+0000","last_peered":"2024-03-19T06:38:37.031845+0000","last_clean":"2024-03-19T06:38:37.031845+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:38:37.031845+0000","last_undegraded":"2024-03-19T06:38:37.031845+0000","last_fullsized":"2024-03-19T06:38:37.031845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'9","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.371952+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:38:05.371952+0000","last_peered":"2024-03-19T06:38:05.371952+0000","last_clean":"2024-03-19T06:38:05.371952+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:38:05.371952+0000","last_undegraded":"2024-03-19T06:38:05.371952+0000","last_fullsized":"2024-03-19T06:38:05.371952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'66","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.388054+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:37:05.388054+0000","last_peered":"2024-03-19T06:37:05.388054+0000","last_clean":"2024-03-19T06:37:05.388054+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:37:05.388054+0000","last_undegraded":"2024-03-19T06:37:05.388054+0000","last_fullsized":"2024-03-19T06:37:05.388054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173607+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:38:37.173607+0000","last_peered":"2024-03-19T06:38:37.173607+0000","last_clean":"2024-03-19T06:38:37.173607+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:38:37.173607+0000","last_undegraded":"2024-03-19T06:38:37.173607+0000","last_fullsized":"2024-03-19T06:38:37.173607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.964088+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:37:38.964088+0000","last_peered":"2024-03-19T06:37:38.964088+0000","last_clean":"2024-03-19T06:37:38.964088+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:37:38.964088+0000","last_undegraded":"2024-03-19T06:37:38.964088+0000","last_fullsized":"2024-03-19T06:37:38.964088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'429","reported_seq":474,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.066792+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:37:46.066792+0000","last_peered":"2024-03-19T06:37:46.066792+0000","last_clean":"2024-03-19T06:37:46.066792+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:37:46.066792+0000","last_undegraded":"2024-03-19T06:37:46.066792+0000","last_fullsized":"2024-03-19T06:37:46.066792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'23","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174549+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:38:37.174549+0000","last_peered":"2024-03-19T06:38:37.174549+0000","last_clean":"2024-03-19T06:38:37.174549+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:38:37.174549+0000","last_undegraded":"2024-03-19T06:38:37.174549+0000","last_fullsized":"2024-03-19T06:38:37.174549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'57","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.329186+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:37:14.329186+0000","last_peered":"2024-03-19T06:37:14.329186+0000","last_clean":"2024-03-19T06:37:14.329186+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:37:14.329186+0000","last_undegraded":"2024-03-19T06:37:14.329186+0000","last_fullsized":"2024-03-19T06:37:14.329186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'545","reported_seq":590,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.760870+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:38:10.760870+0000","last_peered":"2024-03-19T06:38:10.760870+0000","last_clean":"2024-03-19T06:38:10.760870+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:38:10.760870+0000","last_undegraded":"2024-03-19T06:38:10.760870+0000","last_fullsized":"2024-03-19T06:38:10.760870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.036645+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:38:37.036645+0000","last_peered":"2024-03-19T06:38:37.036645+0000","last_clean":"2024-03-19T06:38:37.036645+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:38:37.036645+0000","last_undegraded":"2024-03-19T06:38:37.036645+0000","last_fullsized":"2024-03-19T06:38:37.036645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:10.121030+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:37:10.121030+0000","last_peered":"2024-03-19T06:37:10.121030+0000","last_clean":"2024-03-19T06:37:10.121030+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:37:10.121030+0000","last_undegraded":"2024-03-19T06:37:10.121030+0000","last_fullsized":"2024-03-19T06:37:10.121030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'30","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266686+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:38:37.266686+0000","last_peered":"2024-03-19T06:38:37.266686+0000","last_clean":"2024-03-19T06:38:37.266686+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:38:37.266686+0000","last_undegraded":"2024-03-19T06:38:37.266686+0000","last_fullsized":"2024-03-19T06:38:37.266686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'25","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.117420+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:38:37.117420+0000","last_peered":"2024-03-19T06:38:37.117420+0000","last_clean":"2024-03-19T06:38:37.117420+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:38:37.117420+0000","last_undegraded":"2024-03-19T06:38:37.117420+0000","last_fullsized":"2024-03-19T06:38:37.117420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'25","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116203+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:38:37.116203+0000","last_peered":"2024-03-19T06:38:37.116203+0000","last_clean":"2024-03-19T06:38:37.116203+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:38:37.116203+0000","last_undegraded":"2024-03-19T06:38:37.116203+0000","last_fullsized":"2024-03-19T06:38:37.116203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174107+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:38:37.174107+0000","last_peered":"2024-03-19T06:38:37.174107+0000","last_clean":"2024-03-19T06:38:37.174107+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:38:37.174107+0000","last_undegraded":"2024-03-19T06:38:37.174107+0000","last_fullsized":"2024-03-19T06:38:37.174107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159101+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:38:37.159101+0000","last_peered":"2024-03-19T06:38:37.159101+0000","last_clean":"2024-03-19T06:38:37.159101+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:38:37.159101+0000","last_undegraded":"2024-03-19T06:38:37.159101+0000","last_fullsized":"2024-03-19T06:38:37.159101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030145+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:38:37.030145+0000","last_peered":"2024-03-19T06:38:37.030145+0000","last_clean":"2024-03-19T06:38:37.030145+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:38:37.030145+0000","last_undegraded":"2024-03-19T06:38:37.030145+0000","last_fullsized":"2024-03-19T06:38:37.030145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'34","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.268767+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:38:37.268767+0000","last_peered":"2024-03-19T06:38:37.268767+0000","last_clean":"2024-03-19T06:38:37.268767+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:38:37.268767+0000","last_undegraded":"2024-03-19T06:38:37.268767+0000","last_fullsized":"2024-03-19T06:38:37.268767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'15","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.157048+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:38:37.157048+0000","last_peered":"2024-03-19T06:38:37.157048+0000","last_clean":"2024-03-19T06:38:37.157048+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:38:37.157048+0000","last_undegraded":"2024-03-19T06:38:37.157048+0000","last_fullsized":"2024-03-19T06:38:37.157048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.024849+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:38:37.024849+0000","last_peered":"2024-03-19T06:38:37.024849+0000","last_clean":"2024-03-19T06:38:37.024849+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:38:37.024849+0000","last_undegraded":"2024-03-19T06:38:37.024849+0000","last_fullsized":"2024-03-19T06:38:37.024849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.156166+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:38:37.156166+0000","last_peered":"2024-03-19T06:38:37.156166+0000","last_clean":"2024-03-19T06:38:37.156166+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:38:37.156166+0000","last_undegraded":"2024-03-19T06:38:37.156166+0000","last_fullsized":"2024-03-19T06:38:37.156166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'24","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038453+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:38:37.038453+0000","last_peered":"2024-03-19T06:38:37.038453+0000","last_clean":"2024-03-19T06:38:37.038453+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:38:37.038453+0000","last_undegraded":"2024-03-19T06:38:37.038453+0000","last_fullsized":"2024-03-19T06:38:37.038453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174191+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:38:37.174191+0000","last_peered":"2024-03-19T06:38:37.174191+0000","last_clean":"2024-03-19T06:38:37.174191+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:38:37.174191+0000","last_undegraded":"2024-03-19T06:38:37.174191+0000","last_fullsized":"2024-03-19T06:38:37.174191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266242+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:38:37.266242+0000","last_peered":"2024-03-19T06:38:37.266242+0000","last_clean":"2024-03-19T06:38:37.266242+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:38:37.266242+0000","last_undegraded":"2024-03-19T06:38:37.266242+0000","last_fullsized":"2024-03-19T06:38:37.266242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.997271+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:38:36.997271+0000","last_peered":"2024-03-19T06:38:36.997271+0000","last_clean":"2024-03-19T06:38:36.997271+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:38:36.997271+0000","last_undegraded":"2024-03-19T06:38:36.997271+0000","last_fullsized":"2024-03-19T06:38:36.997271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.112896+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:38:37.112896+0000","last_peered":"2024-03-19T06:38:37.112896+0000","last_clean":"2024-03-19T06:38:37.112896+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:38:37.112896+0000","last_undegraded":"2024-03-19T06:38:37.112896+0000","last_fullsized":"2024-03-19T06:38:37.112896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.022733+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:38:37.022733+0000","last_peered":"2024-03-19T06:38:37.022733+0000","last_clean":"2024-03-19T06:38:37.022733+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:38:37.022733+0000","last_undegraded":"2024-03-19T06:38:37.022733+0000","last_fullsized":"2024-03-19T06:38:37.022733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.027476+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:38:37.027476+0000","last_peered":"2024-03-19T06:38:37.027476+0000","last_clean":"2024-03-19T06:38:37.027476+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:38:37.027476+0000","last_undegraded":"2024-03-19T06:38:37.027476+0000","last_fullsized":"2024-03-19T06:38:37.027476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.033006+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:38:37.033006+0000","last_peered":"2024-03-19T06:38:37.033006+0000","last_clean":"2024-03-19T06:38:37.033006+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:38:37.033006+0000","last_undegraded":"2024-03-19T06:38:37.033006+0000","last_fullsized":"2024-03-19T06:38:37.033006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173314+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:38:37.173314+0000","last_peered":"2024-03-19T06:38:37.173314+0000","last_clean":"2024-03-19T06:38:37.173314+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:38:37.173314+0000","last_undegraded":"2024-03-19T06:38:37.173314+0000","last_fullsized":"2024-03-19T06:38:37.173314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'33","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032462+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:38:37.032462+0000","last_peered":"2024-03-19T06:38:37.032462+0000","last_clean":"2024-03-19T06:38:37.032462+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:38:37.032462+0000","last_undegraded":"2024-03-19T06:38:37.032462+0000","last_fullsized":"2024-03-19T06:38:37.032462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037174+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:38:37.037174+0000","last_peered":"2024-03-19T06:38:37.037174+0000","last_clean":"2024-03-19T06:38:37.037174+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:38:37.037174+0000","last_undegraded":"2024-03-19T06:38:37.037174+0000","last_fullsized":"2024-03-19T06:38:37.037174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.261481+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:38:37.261481+0000","last_peered":"2024-03-19T06:38:37.261481+0000","last_clean":"2024-03-19T06:38:37.261481+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:38:37.261481+0000","last_undegraded":"2024-03-19T06:38:37.261481+0000","last_fullsized":"2024-03-19T06:38:37.261481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'31","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.269944+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:38:37.269944+0000","last_peered":"2024-03-19T06:38:37.269944+0000","last_clean":"2024-03-19T06:38:37.269944+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:38:37.269944+0000","last_undegraded":"2024-03-19T06:38:37.269944+0000","last_fullsized":"2024-03-19T06:38:37.269944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038936+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:38:37.038936+0000","last_peered":"2024-03-19T06:38:37.038936+0000","last_clean":"2024-03-19T06:38:37.038936+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:38:37.038936+0000","last_undegraded":"2024-03-19T06:38:37.038936+0000","last_fullsized":"2024-03-19T06:38:37.038936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160816+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:38:37.160816+0000","last_peered":"2024-03-19T06:38:37.160816+0000","last_clean":"2024-03-19T06:38:37.160816+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:38:37.160816+0000","last_undegraded":"2024-03-19T06:38:37.160816+0000","last_fullsized":"2024-03-19T06:38:37.160816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'17","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.985994+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:38:36.985994+0000","last_peered":"2024-03-19T06:38:36.985994+0000","last_clean":"2024-03-19T06:38:36.985994+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:38:36.985994+0000","last_undegraded":"2024-03-19T06:38:36.985994+0000","last_fullsized":"2024-03-19T06:38:36.985994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115360+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:38:37.115360+0000","last_peered":"2024-03-19T06:38:37.115360+0000","last_clean":"2024-03-19T06:38:37.115360+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:38:37.115360+0000","last_undegraded":"2024-03-19T06:38:37.115360+0000","last_fullsized":"2024-03-19T06:38:37.115360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.002299+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:38:37.002299+0000","last_peered":"2024-03-19T06:38:37.002299+0000","last_clean":"2024-03-19T06:38:37.002299+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:38:37.002299+0000","last_undegraded":"2024-03-19T06:38:37.002299+0000","last_fullsized":"2024-03-19T06:38:37.002299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085837+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:38:37.085837+0000","last_peered":"2024-03-19T06:38:37.085837+0000","last_clean":"2024-03-19T06:38:37.085837+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:38:37.085837+0000","last_undegraded":"2024-03-19T06:38:37.085837+0000","last_fullsized":"2024-03-19T06:38:37.085837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'24","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.166927+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:38:37.166927+0000","last_peered":"2024-03-19T06:38:37.166927+0000","last_clean":"2024-03-19T06:38:37.166927+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:38:37.166927+0000","last_undegraded":"2024-03-19T06:38:37.166927+0000","last_fullsized":"2024-03-19T06:38:37.166927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.023949+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:38:37.023949+0000","last_peered":"2024-03-19T06:38:37.023949+0000","last_clean":"2024-03-19T06:38:37.023949+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:38:37.023949+0000","last_undegraded":"2024-03-19T06:38:37.023949+0000","last_fullsized":"2024-03-19T06:38:37.023949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115848+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:38:37.115848+0000","last_peered":"2024-03-19T06:38:37.115848+0000","last_clean":"2024-03-19T06:38:37.115848+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:38:37.115848+0000","last_undegraded":"2024-03-19T06:38:37.115848+0000","last_fullsized":"2024-03-19T06:38:37.115848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2145,"num_write_kb":250125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2307,"ondisk_log_size":2307,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1476,"ondisk_log_size":1476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22012001,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":7122,"num_write_kb":24983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44269568,"data_stored":44024002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5503,"ondisk_log_size":5503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477133,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":13553664,"data_stored":13317561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719477132,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39876,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331964,"statfs":{"total":96636764160,"available":96595931136,"internally_reserved":0,"allocated":389120,"data_stored":146113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477131,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":8753152,"data_stored":8532119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477131,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":9564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":9793536,"data_stored":9563926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509835,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39724,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332116,"statfs":{"total":96636764160,"available":96596086784,"internally_reserved":0,"allocated":8753152,"data_stored":8532251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509835,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":260733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509835,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":143131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509835,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":5932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":6074368,"data_stored":5841696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5140480,"data_stored":5109729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":119134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9422327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:38:44.814 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-19T06:38:44.814 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:38:45.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.064+0000 7f3cd9a00640 1 Processor -- start 2024-03-19T06:38:45.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.065+0000 7f3cd9a00640 1 -- start start 2024-03-19T06:38:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.066+0000 7f3cd9a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3cd41541d0 0x7f3cd40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.066+0000 7f3cd9a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd415d3b0 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.066+0000 7f3cd9a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd415a0d0 con 0x7f3cd415d860 2024-03-19T06:38:45.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.066+0000 7f3cd9a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd415a3b0 con 0x7f3cd41541d0 2024-03-19T06:38:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.067+0000 7f3cd2000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3cd40cb8d0 0x7f3cd40cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38718/0 (socket says 172.21.15.17:38718) 2024-03-19T06:38:45.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.067+0000 7f3cd2000640 1 -- 172.21.15.17:0/3544179854 learned_addr learned my addr 172.21.15.17:0/3544179854 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:45.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.070+0000 7f3cd2a00640 1 --2- 172.21.15.17:0/3544179854 >> v2:172.21.15.153:3300/0 conn(0x7f3cd41541d0 0x7f3cd40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.071+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004199586 0 0) 0x7f3cd415d3b0 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.071+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb4003520 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051646789 0 0) 0x7f3cb4003520 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 >> v2:172.21.15.153:3300/0 conn(0x7f3cd41541d0 msgr2=0x7f3cd40ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:45.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 --2- 172.21.15.17:0/3544179854 >> v2:172.21.15.153:3300/0 conn(0x7f3cd41541d0 0x7f3cd40ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 >> v1:172.21.15.153:6789/0 conn(0x7f3cd415d860 legacy=0x7f3cd415dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd415a690 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f3cbc0019f0 con 0x7f3cd40cb8d0 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 >> v1:172.21.15.17:6789/0 conn(0x7f3cd40cb8d0 legacy=0x7f3cd40cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb4003a00 0x7f3cb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb4004800 0x7f3cb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415a3b0 con 0x7f3cb40051c0 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb400c0a0 con 0x7f3cb4003a00 2024-03-19T06:38:45.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.076+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb400c2a0 con 0x7f3cb4004800 2024-03-19T06:38:45.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.078+0000 7f3cd2000640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb4004800 0x7f3cb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.081+0000 7f3cd3400640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.086+0000 7f3cd3400640 1 -- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb4004800 msgr2=0x7f3cb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.086+0000 7f3cd3400640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cb4004800 0x7f3cb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.086+0000 7f3cd3400640 1 -- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb4003a00 msgr2=0x7f3cb4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.086+0000 7f3cd3400640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cb4003a00 0x7f3cb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.086+0000 7f3cd3400640 1 -- 172.21.15.17:0/3544179854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4003520 con 0x7f3cb40051c0 2024-03-19T06:38:45.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.087+0000 7f3cd3400640 1 -- 172.21.15.17:0/3544179854 reap_dead start 2024-03-19T06:38:45.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.089+0000 7f3cd3400640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cb400b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001750 tx=0x7f3cb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe9b1d3ef90ab82 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:45.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.094+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc001370 con 0x7f3cb40051c0 2024-03-19T06:38:45.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.094+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0052f0 con 0x7f3cb40051c0 2024-03-19T06:38:45.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.094+0000 7f3cd1600640 1 -- 172.21.15.17:0/3544179854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc003830 con 0x7f3cb40051c0 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 msgr2=0x7f3cb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cb400b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc001750 tx=0x7f3cb4005830 comp rx=0 tx=0).stop 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3544179854 shutdown_connections 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3544179854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cb400b9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3544179854 >> 172.21.15.17:0/3544179854 conn(0x7f3cd406baf0 msgr2=0x7f3cd406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3544179854 shutdown_connections 2024-03-19T06:38:45.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.095+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3544179854 wait complete. 2024-03-19T06:38:45.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.097+0000 7f3cd9a00640 1 Processor -- start 2024-03-19T06:38:45.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.097+0000 7f3cd9a00640 1 -- start start 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cd414d1b0 0x7f3cd415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd40b39e0 0x7f3cd4147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415ac50 con 0x7f3cb40051c0 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd4159da0 con 0x7f3cd40b39e0 2024-03-19T06:38:45.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.098+0000 7f3cd9a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415dc90 con 0x7f3cd414d1b0 2024-03-19T06:38:45.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.099+0000 7f3cd2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.099+0000 7f3cd2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60362/0 (socket says 172.21.15.17:60362) 2024-03-19T06:38:45.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.099+0000 7f3cd2a00640 1 -- 172.21.15.17:0/3122383770 learned_addr learned my addr 172.21.15.17:0/3122383770 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:45.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.100+0000 7f3cd2000640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cd414d1b0 0x7f3cd415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd3400640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd40b39e0 0x7f3cd4147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd2a00640 1 -- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cd414d1b0 msgr2=0x7f3cd415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd2a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cd414d1b0 0x7f3cd415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd2a00640 1 -- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd40b39e0 msgr2=0x7f3cd4147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd2a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd40b39e0 0x7f3cd4147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.103+0000 7f3cd2a00640 1 -- 172.21.15.17:0/3122383770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40b3500 con 0x7f3cb40051c0 2024-03-19T06:38:45.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.106+0000 7f3cd2a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e7a0 tx=0x7f3cc400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.110+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4017070 con 0x7f3cb40051c0 2024-03-19T06:38:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.110+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc400c940 con 0x7f3cb40051c0 2024-03-19T06:38:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.110+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc400cd10 con 0x7f3cb40051c0 2024-03-19T06:38:45.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.110+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd415b590 con 0x7f3cb40051c0 2024-03-19T06:38:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.110+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd415bb50 con 0x7f3cb40051c0 2024-03-19T06:38:45.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.112+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd4069be0 con 0x7f3cb40051c0 2024-03-19T06:38:45.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.133+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3cc401a070 con 0x7f3cb40051c0 2024-03-19T06:38:45.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.135+0000 7f3ccaa00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 0x7f3cb006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.135+0000 7f3cd2000640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 0x7f3cb006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.136+0000 7f3cd2000640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 0x7f3cb006e110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40ccbb0 tx=0x7f3cbc006040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:45.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.136+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3cc40575c0 con 0x7f3cb40051c0 2024-03-19T06:38:45.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.449+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f3cc4059c20 con 0x7f3cb40051c0 2024-03-19T06:38:45.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.674+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cd40cab70 con 0x7f3cb006bc50 2024-03-19T06:38:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.689+0000 7f3ccaa00640 1 -- 172.21.15.17:0/3122383770 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+333458 (secure 0 0 0) 0x7f3cd40cab70 con 0x7f3cb006bc50 2024-03-19T06:38:45.678 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 msgr2=0x7f3cb006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 0x7f3cb006e110 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3cd40ccbb0 tx=0x7f3cbc006040 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 msgr2=0x7f3cd414b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400e7a0 tx=0x7f3cc400ec60 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 shutdown_connections 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3cb006bc50 0x7f3cb006e110 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd40b39e0 0x7f3cd4147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3cd414d1b0 0x7f3cd415c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 --2- 172.21.15.17:0/3122383770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb40051c0 0x7f3cd414b5e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 >> 172.21.15.17:0/3122383770 conn(0x7f3cd406baf0 msgr2=0x7f3cd4157c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 shutdown_connections 2024-03-19T06:38:45.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.696+0000 7f3cd9a00640 1 -- 172.21.15.17:0/3122383770 wait complete. 2024-03-19T06:38:45.698 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":1002,"stamp":"2024-03-19T06:38:44.246534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22602369,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":597,"num_read_kb":611,"num_write":9426,"num_write_kb":277524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9403,"ondisk_log_size":9403,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317256,"kb_used_data":47048,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754657464,"statfs":{"total":773094113280,"available":772769243136,"internally_reserved":0,"allocated":48177152,"data_stored":46337530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12157,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004910"},"pg_stats":[{"pgid":"2.1f","version":"32'658","reported_seq":706,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.067199+0000","last_change":"2024-03-19T06:06:33.097354+0000","last_active":"2024-03-19T06:37:46.067199+0000","last_peered":"2024-03-19T06:37:46.067199+0000","last_clean":"2024-03-19T06:37:46.067199+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:37:46.067199+0000","last_undegraded":"2024-03-19T06:37:46.067199+0000","last_fullsized":"2024-03-19T06:37:46.067199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:34:19.424247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.154376+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:38:37.154376+0000","last_peered":"2024-03-19T06:38:37.154376+0000","last_clean":"2024-03-19T06:38:37.154376+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:38:37.154376+0000","last_undegraded":"2024-03-19T06:38:37.154376+0000","last_fullsized":"2024-03-19T06:38:37.154376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'60","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.594249+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:37:15.594249+0000","last_peered":"2024-03-19T06:37:15.594249+0000","last_clean":"2024-03-19T06:37:15.594249+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:37:15.594249+0000","last_undegraded":"2024-03-19T06:37:15.594249+0000","last_fullsized":"2024-03-19T06:37:15.594249+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'93","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.466869+0000","last_change":"2024-03-19T06:06:32.985885+0000","last_active":"2024-03-19T06:38:37.466869+0000","last_peered":"2024-03-19T06:38:37.466869+0000","last_clean":"2024-03-19T06:38:37.466869+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:38:37.466869+0000","last_undegraded":"2024-03-19T06:38:37.466869+0000","last_fullsized":"2024-03-19T06:38:37.466869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":914551,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171494+0000","last_change":"2024-03-19T06:06:34.541966+0000","last_active":"2024-03-19T06:38:37.171494+0000","last_peered":"2024-03-19T06:38:37.171494+0000","last_clean":"2024-03-19T06:38:37.171494+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:38:37.171494+0000","last_undegraded":"2024-03-19T06:38:37.171494+0000","last_fullsized":"2024-03-19T06:38:37.171494+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'63","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:55.649400+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:36:55.649400+0000","last_peered":"2024-03-19T06:36:55.649400+0000","last_clean":"2024-03-19T06:36:55.649400+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:36:55.649400+0000","last_undegraded":"2024-03-19T06:36:55.649400+0000","last_fullsized":"2024-03-19T06:36:55.649400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.862771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.779829+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:38:11.779829+0000","last_peered":"2024-03-19T06:38:11.779829+0000","last_clean":"2024-03-19T06:38:11.779829+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:38:11.779829+0000","last_undegraded":"2024-03-19T06:38:11.779829+0000","last_fullsized":"2024-03-19T06:38:11.779829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:35.546416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085166+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:38:37.085166+0000","last_peered":"2024-03-19T06:38:37.085166+0000","last_clean":"2024-03-19T06:38:37.085166+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:38:37.085166+0000","last_undegraded":"2024-03-19T06:38:37.085166+0000","last_fullsized":"2024-03-19T06:38:37.085166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'72","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.947835+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:37:12.947835+0000","last_peered":"2024-03-19T06:37:12.947835+0000","last_clean":"2024-03-19T06:37:12.947835+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:37:12.947835+0000","last_undegraded":"2024-03-19T06:37:12.947835+0000","last_fullsized":"2024-03-19T06:37:12.947835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:22.041633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:33.116946+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:36:33.116946+0000","last_peered":"2024-03-19T06:36:33.116946+0000","last_clean":"2024-03-19T06:36:33.116946+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:36:33.116946+0000","last_undegraded":"2024-03-19T06:36:33.116946+0000","last_fullsized":"2024-03-19T06:36:33.116946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:37.900554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'31","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038109+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:38:37.038109+0000","last_peered":"2024-03-19T06:38:37.038109+0000","last_clean":"2024-03-19T06:38:37.038109+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:38:37.038109+0000","last_undegraded":"2024-03-19T06:38:37.038109+0000","last_fullsized":"2024-03-19T06:38:37.038109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.839487+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:37:17.839487+0000","last_peered":"2024-03-19T06:37:17.839487+0000","last_clean":"2024-03-19T06:37:17.839487+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:37:17.839487+0000","last_undegraded":"2024-03-19T06:37:17.839487+0000","last_fullsized":"2024-03-19T06:37:17.839487+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:11.737194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266186+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:38:37.266186+0000","last_peered":"2024-03-19T06:38:37.266186+0000","last_clean":"2024-03-19T06:38:37.266186+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:38:37.266186+0000","last_undegraded":"2024-03-19T06:38:37.266186+0000","last_fullsized":"2024-03-19T06:38:37.266186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:53:49.419349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'679","reported_seq":726,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:03.132901+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:38:03.132901+0000","last_peered":"2024-03-19T06:38:03.132901+0000","last_clean":"2024-03-19T06:38:03.132901+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:38:03.132901+0000","last_undegraded":"2024-03-19T06:38:03.132901+0000","last_fullsized":"2024-03-19T06:38:03.132901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:16:16.602599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'61","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.740237+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:37:19.740237+0000","last_peered":"2024-03-19T06:37:19.740237+0000","last_clean":"2024-03-19T06:37:19.740237+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:37:19.740237+0000","last_undegraded":"2024-03-19T06:37:19.740237+0000","last_fullsized":"2024-03-19T06:37:19.740237+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:24.322731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173890+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:38:37.173890+0000","last_peered":"2024-03-19T06:38:37.173890+0000","last_clean":"2024-03-19T06:38:37.173890+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:38:37.173890+0000","last_undegraded":"2024-03-19T06:38:37.173890+0000","last_fullsized":"2024-03-19T06:38:37.173890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:48.581094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:51.658227+0000","last_change":"2024-03-19T06:06:33.006020+0000","last_active":"2024-03-19T06:37:51.658227+0000","last_peered":"2024-03-19T06:37:51.658227+0000","last_clean":"2024-03-19T06:37:51.658227+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:37:51.658227+0000","last_undegraded":"2024-03-19T06:37:51.658227+0000","last_fullsized":"2024-03-19T06:37:51.658227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:04.205964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'90","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.611055+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:37:19.611055+0000","last_peered":"2024-03-19T06:37:19.611055+0000","last_clean":"2024-03-19T06:37:19.611055+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:37:19.611055+0000","last_undegraded":"2024-03-19T06:37:19.611055+0000","last_fullsized":"2024-03-19T06:37:19.611055+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:53.764103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":8470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159403+0000","last_change":"2024-03-19T06:06:34.586735+0000","last_active":"2024-03-19T06:38:37.159403+0000","last_peered":"2024-03-19T06:38:37.159403+0000","last_clean":"2024-03-19T06:38:37.159403+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:38:37.159403+0000","last_undegraded":"2024-03-19T06:38:37.159403+0000","last_fullsized":"2024-03-19T06:38:37.159403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:22.759221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:31.382833+0000","last_change":"2024-03-19T06:06:33.096384+0000","last_active":"2024-03-19T06:37:31.382833+0000","last_peered":"2024-03-19T06:37:31.382833+0000","last_clean":"2024-03-19T06:37:31.382833+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:37:31.382833+0000","last_undegraded":"2024-03-19T06:37:31.382833+0000","last_fullsized":"2024-03-19T06:37:31.382833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:13:36.406497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'65","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.616840+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:37:15.616840+0000","last_peered":"2024-03-19T06:37:15.616840+0000","last_clean":"2024-03-19T06:37:15.616840+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:37:15.616840+0000","last_undegraded":"2024-03-19T06:37:15.616840+0000","last_fullsized":"2024-03-19T06:37:15.616840+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":11230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.509408+0000","last_change":"2024-03-19T06:06:34.524367+0000","last_active":"2024-03-19T06:37:18.509408+0000","last_peered":"2024-03-19T06:37:18.509408+0000","last_clean":"2024-03-19T06:37:18.509408+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:37:18.509408+0000","last_undegraded":"2024-03-19T06:37:18.509408+0000","last_fullsized":"2024-03-19T06:37:18.509408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:44:27.152124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'9","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.838516+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:38:10.838516+0000","last_peered":"2024-03-19T06:38:10.838516+0000","last_clean":"2024-03-19T06:38:10.838516+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:38:10.838516+0000","last_undegraded":"2024-03-19T06:38:10.838516+0000","last_fullsized":"2024-03-19T06:38:10.838516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'67","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.511740+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:37:18.511740+0000","last_peered":"2024-03-19T06:37:18.511740+0000","last_clean":"2024-03-19T06:37:18.511740+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:37:18.511740+0000","last_undegraded":"2024-03-19T06:37:18.511740+0000","last_fullsized":"2024-03-19T06:37:18.511740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:33.262205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'28","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173332+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:38:37.173332+0000","last_peered":"2024-03-19T06:38:37.173332+0000","last_clean":"2024-03-19T06:38:37.173332+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:38:37.173332+0000","last_undegraded":"2024-03-19T06:38:37.173332+0000","last_fullsized":"2024-03-19T06:38:37.173332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:32:22.247861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.763816+0000","last_change":"2024-03-19T06:06:33.107614+0000","last_active":"2024-03-19T06:38:11.763816+0000","last_peered":"2024-03-19T06:38:11.763816+0000","last_clean":"2024-03-19T06:38:11.763816+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:38:11.763816+0000","last_undegraded":"2024-03-19T06:38:11.763816+0000","last_fullsized":"2024-03-19T06:38:11.763816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:03:54.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'50","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.829685+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:37:17.829685+0000","last_peered":"2024-03-19T06:37:17.829685+0000","last_clean":"2024-03-19T06:37:17.829685+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:37:17.829685+0000","last_undegraded":"2024-03-19T06:37:17.829685+0000","last_fullsized":"2024-03-19T06:37:17.829685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:38.589693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160467+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:38:37.160467+0000","last_peered":"2024-03-19T06:38:37.160467+0000","last_clean":"2024-03-19T06:38:37.160467+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:38:37.160467+0000","last_undegraded":"2024-03-19T06:38:37.160467+0000","last_fullsized":"2024-03-19T06:38:37.160467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'1210","reported_seq":1257,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:29.328934+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:38:29.328934+0000","last_peered":"2024-03-19T06:38:29.328934+0000","last_clean":"2024-03-19T06:38:29.328934+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:38:29.328934+0000","last_undegraded":"2024-03-19T06:38:29.328934+0000","last_fullsized":"2024-03-19T06:38:29.328934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:11:25.947394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'85","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.611281+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:37:14.611281+0000","last_peered":"2024-03-19T06:37:14.611281+0000","last_clean":"2024-03-19T06:37:14.611281+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:37:14.611281+0000","last_undegraded":"2024-03-19T06:37:14.611281+0000","last_fullsized":"2024-03-19T06:37:14.611281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:09:17.942582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":11129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030046+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:38:37.030046+0000","last_peered":"2024-03-19T06:38:37.030046+0000","last_clean":"2024-03-19T06:38:37.030046+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:38:37.030046+0000","last_undegraded":"2024-03-19T06:38:37.030046+0000","last_fullsized":"2024-03-19T06:38:37.030046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:53.131139+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:37:53.131139+0000","last_peered":"2024-03-19T06:37:53.131139+0000","last_clean":"2024-03-19T06:37:53.131139+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:37:53.131139+0000","last_undegraded":"2024-03-19T06:37:53.131139+0000","last_fullsized":"2024-03-19T06:37:53.131139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:44.804147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'48","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.734172+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:37:19.734172+0000","last_peered":"2024-03-19T06:37:19.734172+0000","last_clean":"2024-03-19T06:37:19.734172+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:37:19.734172+0000","last_undegraded":"2024-03-19T06:37:19.734172+0000","last_fullsized":"2024-03-19T06:37:19.734172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:09:38.645931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":5603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026364+0000","last_change":"2024-03-19T06:06:34.538517+0000","last_active":"2024-03-19T06:38:37.026364+0000","last_peered":"2024-03-19T06:38:37.026364+0000","last_clean":"2024-03-19T06:38:37.026364+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:38:37.026364+0000","last_undegraded":"2024-03-19T06:38:37.026364+0000","last_fullsized":"2024-03-19T06:38:37.026364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:52:24.980527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:47.292216+0000","last_change":"2024-03-19T06:06:33.003930+0000","last_active":"2024-03-19T06:37:47.292216+0000","last_peered":"2024-03-19T06:37:47.292216+0000","last_clean":"2024-03-19T06:37:47.292216+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:37:47.292216+0000","last_undegraded":"2024-03-19T06:37:47.292216+0000","last_fullsized":"2024-03-19T06:37:47.292216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:22.268176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'69","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.597812+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:37:14.597812+0000","last_peered":"2024-03-19T06:37:14.597812+0000","last_clean":"2024-03-19T06:37:14.597812+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:37:14.597812+0000","last_undegraded":"2024-03-19T06:37:14.597812+0000","last_fullsized":"2024-03-19T06:37:14.597812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.026235+0000","last_change":"2024-03-19T06:06:34.348071+0000","last_active":"2024-03-19T06:38:37.026235+0000","last_peered":"2024-03-19T06:38:37.026235+0000","last_clean":"2024-03-19T06:38:37.026235+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:38:37.026235+0000","last_undegraded":"2024-03-19T06:38:37.026235+0000","last_fullsized":"2024-03-19T06:38:37.026235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:14:14.506522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'10","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.337649+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:38:20.337649+0000","last_peered":"2024-03-19T06:38:20.337649+0000","last_clean":"2024-03-19T06:38:20.337649+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:38:20.337649+0000","last_undegraded":"2024-03-19T06:38:20.337649+0000","last_fullsized":"2024-03-19T06:38:20.337649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:06:12.444198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'57","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.743175+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:37:19.743175+0000","last_peered":"2024-03-19T06:37:19.743175+0000","last_clean":"2024-03-19T06:37:19.743175+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:37:19.743175+0000","last_undegraded":"2024-03-19T06:37:19.743175+0000","last_fullsized":"2024-03-19T06:37:19.743175+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'24","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031677+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:38:37.031677+0000","last_peered":"2024-03-19T06:38:37.031677+0000","last_clean":"2024-03-19T06:38:37.031677+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:38:37.031677+0000","last_undegraded":"2024-03-19T06:38:37.031677+0000","last_fullsized":"2024-03-19T06:38:37.031677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'498","reported_seq":1027,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:25.505665+0000","last_change":"2024-03-19T06:06:33.087213+0000","last_active":"2024-03-19T06:38:25.505665+0000","last_peered":"2024-03-19T06:38:25.505665+0000","last_clean":"2024-03-19T06:38:25.505665+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:38:25.505665+0000","last_undegraded":"2024-03-19T06:38:25.505665+0000","last_fullsized":"2024-03-19T06:38:25.505665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:39:54.674870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117202,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":494,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'60","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618658+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:37:15.618658+0000","last_peered":"2024-03-19T06:37:15.618658+0000","last_clean":"2024-03-19T06:37:15.618658+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:37:15.618658+0000","last_undegraded":"2024-03-19T06:37:15.618658+0000","last_fullsized":"2024-03-19T06:37:15.618658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'13","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.167195+0000","last_change":"2024-03-19T06:06:34.339965+0000","last_active":"2024-03-19T06:38:37.167195+0000","last_peered":"2024-03-19T06:38:37.167195+0000","last_clean":"2024-03-19T06:38:37.167195+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:38:37.167195+0000","last_undegraded":"2024-03-19T06:38:37.167195+0000","last_fullsized":"2024-03-19T06:38:37.167195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:39:05.477175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:23.529286+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:38:23.529286+0000","last_peered":"2024-03-19T06:38:23.529286+0000","last_clean":"2024-03-19T06:38:23.529286+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:38:23.529286+0000","last_undegraded":"2024-03-19T06:38:23.529286+0000","last_fullsized":"2024-03-19T06:38:23.529286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'93","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.098216+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:37:17.098216+0000","last_peered":"2024-03-19T06:37:17.098216+0000","last_clean":"2024-03-19T06:37:17.098216+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:37:17.098216+0000","last_undegraded":"2024-03-19T06:37:17.098216+0000","last_fullsized":"2024-03-19T06:37:17.098216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:40:47.241136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.153982+0000","last_change":"2024-03-19T06:06:34.547009+0000","last_active":"2024-03-19T06:38:37.153982+0000","last_peered":"2024-03-19T06:38:37.153982+0000","last_clean":"2024-03-19T06:38:37.153982+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:38:37.153982+0000","last_undegraded":"2024-03-19T06:38:37.153982+0000","last_fullsized":"2024-03-19T06:38:37.153982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:28:34.465772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'11","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:20.348283+0000","last_change":"2024-03-19T06:06:33.094758+0000","last_active":"2024-03-19T06:38:20.348283+0000","last_peered":"2024-03-19T06:38:20.348283+0000","last_clean":"2024-03-19T06:38:20.348283+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:38:20.348283+0000","last_undegraded":"2024-03-19T06:38:20.348283+0000","last_fullsized":"2024-03-19T06:38:20.348283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:18.113959+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:36:18.113959+0000","last_peered":"2024-03-19T06:36:18.113959+0000","last_clean":"2024-03-19T06:36:18.113959+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:36:18.113959+0000","last_undegraded":"2024-03-19T06:36:18.113959+0000","last_fullsized":"2024-03-19T06:36:18.113959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:23:51.005258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'67","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.095497+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:37:17.095497+0000","last_peered":"2024-03-19T06:37:17.095497+0000","last_clean":"2024-03-19T06:37:17.095497+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:37:17.095497+0000","last_undegraded":"2024-03-19T06:37:17.095497+0000","last_fullsized":"2024-03-19T06:37:17.095497+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:21:05.024325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087488+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:38:37.087488+0000","last_peered":"2024-03-19T06:38:37.087488+0000","last_clean":"2024-03-19T06:38:37.087488+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:38:37.087488+0000","last_undegraded":"2024-03-19T06:38:37.087488+0000","last_fullsized":"2024-03-19T06:38:37.087488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:02.268841+0000","last_change":"2024-03-19T06:06:33.094869+0000","last_active":"2024-03-19T06:38:02.268841+0000","last_peered":"2024-03-19T06:38:02.268841+0000","last_clean":"2024-03-19T06:38:02.268841+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:38:02.268841+0000","last_undegraded":"2024-03-19T06:38:02.268841+0000","last_fullsized":"2024-03-19T06:38:02.268841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:28:55.474970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'77","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:07.191063+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:37:07.191063+0000","last_peered":"2024-03-19T06:37:07.191063+0000","last_clean":"2024-03-19T06:37:07.191063+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:37:07.191063+0000","last_undegraded":"2024-03-19T06:37:07.191063+0000","last_fullsized":"2024-03-19T06:37:07.191063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:05:54.569506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"32'20","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.020683+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:38:37.020683+0000","last_peered":"2024-03-19T06:38:37.020683+0000","last_clean":"2024-03-19T06:38:37.020683+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:38:37.020683+0000","last_undegraded":"2024-03-19T06:38:37.020683+0000","last_fullsized":"2024-03-19T06:38:37.020683+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.370830+0000","last_change":"2024-03-19T06:06:33.076124+0000","last_active":"2024-03-19T06:38:05.370830+0000","last_peered":"2024-03-19T06:38:05.370830+0000","last_clean":"2024-03-19T06:38:05.370830+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:38:05.370830+0000","last_undegraded":"2024-03-19T06:38:05.370830+0000","last_fullsized":"2024-03-19T06:38:05.370830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:56:56.875981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'101","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.547085+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:37:18.547085+0000","last_peered":"2024-03-19T06:37:18.547085+0000","last_clean":"2024-03-19T06:37:18.547085+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:37:18.547085+0000","last_undegraded":"2024-03-19T06:37:18.547085+0000","last_fullsized":"2024-03-19T06:37:18.547085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:30:20.281300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":8077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087400+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:38:37.087400+0000","last_peered":"2024-03-19T06:38:37.087400+0000","last_clean":"2024-03-19T06:38:37.087400+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:38:37.087400+0000","last_undegraded":"2024-03-19T06:38:37.087400+0000","last_fullsized":"2024-03-19T06:38:37.087400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:52:34.269426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.963636+0000","last_change":"2024-03-19T06:06:33.089986+0000","last_active":"2024-03-19T06:37:38.963636+0000","last_peered":"2024-03-19T06:37:38.963636+0000","last_clean":"2024-03-19T06:37:38.963636+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:37:38.963636+0000","last_undegraded":"2024-03-19T06:37:38.963636+0000","last_fullsized":"2024-03-19T06:37:38.963636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:23:09.919795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'66","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.569020+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:37:12.569020+0000","last_peered":"2024-03-19T06:37:12.569020+0000","last_clean":"2024-03-19T06:37:12.569020+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:37:12.569020+0000","last_undegraded":"2024-03-19T06:37:12.569020+0000","last_fullsized":"2024-03-19T06:37:12.569020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:10:43.298752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'16","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032178+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:38:37.032178+0000","last_peered":"2024-03-19T06:38:37.032178+0000","last_clean":"2024-03-19T06:38:37.032178+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:38:37.032178+0000","last_undegraded":"2024-03-19T06:38:37.032178+0000","last_fullsized":"2024-03-19T06:38:37.032178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:14:27.617961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'8","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.047495+0000","last_change":"2024-03-19T06:06:33.077496+0000","last_active":"2024-03-19T06:38:16.047495+0000","last_peered":"2024-03-19T06:38:16.047495+0000","last_clean":"2024-03-19T06:38:16.047495+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:38:16.047495+0000","last_undegraded":"2024-03-19T06:38:16.047495+0000","last_fullsized":"2024-03-19T06:38:16.047495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:46:29.558675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'94","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.007381+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:37:17.007381+0000","last_peered":"2024-03-19T06:37:17.007381+0000","last_clean":"2024-03-19T06:37:17.007381+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:37:17.007381+0000","last_undegraded":"2024-03-19T06:37:17.007381+0000","last_fullsized":"2024-03-19T06:37:17.007381+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:54.357036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'23","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.029144+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:38:37.029144+0000","last_peered":"2024-03-19T06:38:37.029144+0000","last_clean":"2024-03-19T06:38:37.029144+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:38:37.029144+0000","last_undegraded":"2024-03-19T06:38:37.029144+0000","last_fullsized":"2024-03-19T06:38:37.029144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:45.610526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:42.862515+0000","last_change":"2024-03-19T06:06:33.089114+0000","last_active":"2024-03-19T06:37:42.862515+0000","last_peered":"2024-03-19T06:37:42.862515+0000","last_clean":"2024-03-19T06:37:42.862515+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:37:42.862515+0000","last_undegraded":"2024-03-19T06:37:42.862515+0000","last_fullsized":"2024-03-19T06:37:42.862515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:17.543025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'78","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.504900+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:37:15.504900+0000","last_peered":"2024-03-19T06:37:15.504900+0000","last_clean":"2024-03-19T06:37:15.504900+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:37:15.504900+0000","last_undegraded":"2024-03-19T06:37:15.504900+0000","last_fullsized":"2024-03-19T06:37:15.504900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.255304+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:38:37.255304+0000","last_peered":"2024-03-19T06:38:37.255304+0000","last_clean":"2024-03-19T06:38:37.255304+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:38:37.255304+0000","last_undegraded":"2024-03-19T06:38:37.255304+0000","last_fullsized":"2024-03-19T06:38:37.255304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:31:45.137625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:36:52.188328+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:36:52.188328+0000","last_peered":"2024-03-19T06:36:52.188328+0000","last_clean":"2024-03-19T06:36:52.188328+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:36:52.188328+0000","last_undegraded":"2024-03-19T06:36:52.188328+0000","last_fullsized":"2024-03-19T06:36:52.188328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:45:19.045614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'70","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.601649+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:37:19.601649+0000","last_peered":"2024-03-19T06:37:19.601649+0000","last_clean":"2024-03-19T06:37:19.601649+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:37:19.601649+0000","last_undegraded":"2024-03-19T06:37:19.601649+0000","last_fullsized":"2024-03-19T06:37:19.601649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:02.360675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'36","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.089634+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:38:37.089634+0000","last_peered":"2024-03-19T06:38:37.089634+0000","last_clean":"2024-03-19T06:38:37.089634+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:38:37.089634+0000","last_undegraded":"2024-03-19T06:38:37.089634+0000","last_fullsized":"2024-03-19T06:38:37.089634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:43:04.093643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:17.098272+0000","last_change":"2024-03-19T06:06:33.092387+0000","last_active":"2024-03-19T06:38:17.098272+0000","last_peered":"2024-03-19T06:38:17.098272+0000","last_clean":"2024-03-19T06:38:17.098272+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:38:17.098272+0000","last_undegraded":"2024-03-19T06:38:17.098272+0000","last_fullsized":"2024-03-19T06:38:17.098272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:10:26.403527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.589025+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:37:05.589025+0000","last_peered":"2024-03-19T06:37:05.589025+0000","last_clean":"2024-03-19T06:37:05.589025+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:37:05.589025+0000","last_undegraded":"2024-03-19T06:37:05.589025+0000","last_fullsized":"2024-03-19T06:37:05.589025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:24:34.006012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.170926+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:38:37.170926+0000","last_peered":"2024-03-19T06:38:37.170926+0000","last_clean":"2024-03-19T06:38:37.170926+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:38:37.170926+0000","last_undegraded":"2024-03-19T06:38:37.170926+0000","last_fullsized":"2024-03-19T06:38:37.170926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:23.539388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'10","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:34:32.448275+0000","last_change":"2024-03-19T06:06:33.078449+0000","last_active":"2024-03-19T06:34:32.448275+0000","last_peered":"2024-03-19T06:34:32.448275+0000","last_clean":"2024-03-19T06:34:32.448275+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:34:32.448275+0000","last_undegraded":"2024-03-19T06:34:32.448275+0000","last_fullsized":"2024-03-19T06:34:32.448275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:24:21.722269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'61","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.735140+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:37:17.735140+0000","last_peered":"2024-03-19T06:37:17.735140+0000","last_clean":"2024-03-19T06:37:17.735140+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:37:17.735140+0000","last_undegraded":"2024-03-19T06:37:17.735140+0000","last_fullsized":"2024-03-19T06:37:17.735140+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:20:16.621635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'18","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.021602+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:38:37.021602+0000","last_peered":"2024-03-19T06:38:37.021602+0000","last_clean":"2024-03-19T06:38:37.021602+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:38:37.021602+0000","last_undegraded":"2024-03-19T06:38:37.021602+0000","last_fullsized":"2024-03-19T06:38:37.021602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:35:45.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'840","reported_seq":886,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.113886+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:38:16.113886+0000","last_peered":"2024-03-19T06:38:16.113886+0000","last_clean":"2024-03-19T06:38:16.113886+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:38:16.113886+0000","last_undegraded":"2024-03-19T06:38:16.113886+0000","last_fullsized":"2024-03-19T06:38:16.113886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:29:22.515586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'84","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:15.618484+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:37:15.618484+0000","last_peered":"2024-03-19T06:37:15.618484+0000","last_clean":"2024-03-19T06:37:15.618484+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:37:15.618484+0000","last_undegraded":"2024-03-19T06:37:15.618484+0000","last_fullsized":"2024-03-19T06:37:15.618484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:19:12.978351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":13735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'24","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037016+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:38:37.037016+0000","last_peered":"2024-03-19T06:38:37.037016+0000","last_clean":"2024-03-19T06:38:37.037016+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:38:37.037016+0000","last_undegraded":"2024-03-19T06:38:37.037016+0000","last_fullsized":"2024-03-19T06:38:37.037016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:46:34.847591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'333","reported_seq":379,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:24.527850+0000","last_change":"2024-03-19T06:06:33.088907+0000","last_active":"2024-03-19T06:38:24.527850+0000","last_peered":"2024-03-19T06:38:24.527850+0000","last_clean":"2024-03-19T06:38:24.527850+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:38:24.527850+0000","last_undegraded":"2024-03-19T06:38:24.527850+0000","last_fullsized":"2024-03-19T06:38:24.527850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:47:48.714534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'115","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.249693+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:37:03.249693+0000","last_peered":"2024-03-19T06:37:03.249693+0000","last_clean":"2024-03-19T06:37:03.249693+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:37:03.249693+0000","last_undegraded":"2024-03-19T06:37:03.249693+0000","last_fullsized":"2024-03-19T06:37:03.249693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:40.183125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":11739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'25","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171351+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:38:37.171351+0000","last_peered":"2024-03-19T06:38:37.171351+0000","last_clean":"2024-03-19T06:38:37.171351+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:38:37.171351+0000","last_undegraded":"2024-03-19T06:38:37.171351+0000","last_fullsized":"2024-03-19T06:38:37.171351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'7","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:06.360670+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:38:06.360670+0000","last_peered":"2024-03-19T06:38:06.360670+0000","last_clean":"2024-03-19T06:38:06.360670+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:38:06.360670+0000","last_undegraded":"2024-03-19T06:38:06.360670+0000","last_fullsized":"2024-03-19T06:38:06.360670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:34.791721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'77","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:06.179460+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:37:06.179460+0000","last_peered":"2024-03-19T06:37:06.179460+0000","last_clean":"2024-03-19T06:37:06.179460+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:37:06.179460+0000","last_undegraded":"2024-03-19T06:37:06.179460+0000","last_fullsized":"2024-03-19T06:37:06.179460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:57:58.022659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.063076+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:38:37.063076+0000","last_peered":"2024-03-19T06:38:37.063076+0000","last_clean":"2024-03-19T06:38:37.063076+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:38:37.063076+0000","last_undegraded":"2024-03-19T06:38:37.063076+0000","last_fullsized":"2024-03-19T06:38:37.063076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.662309+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:38:36.662309+0000","last_peered":"2024-03-19T06:38:36.662309+0000","last_clean":"2024-03-19T06:38:36.662309+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:38:36.662309+0000","last_undegraded":"2024-03-19T06:38:36.662309+0000","last_fullsized":"2024-03-19T06:38:36.662309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:10:53.377595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'86","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.001662+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:37:17.001662+0000","last_peered":"2024-03-19T06:37:17.001662+0000","last_clean":"2024-03-19T06:37:17.001662+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:37:17.001662+0000","last_undegraded":"2024-03-19T06:37:17.001662+0000","last_fullsized":"2024-03-19T06:37:17.001662+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:47:14.637426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":9535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'52","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:03.126017+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:37:03.126017+0000","last_peered":"2024-03-19T06:37:03.126017+0000","last_clean":"2024-03-19T06:37:03.126017+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:37:03.126017+0000","last_undegraded":"2024-03-19T06:37:03.126017+0000","last_fullsized":"2024-03-19T06:37:03.126017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:12:29.767432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'27","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.031845+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:38:37.031845+0000","last_peered":"2024-03-19T06:38:37.031845+0000","last_clean":"2024-03-19T06:38:37.031845+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:38:37.031845+0000","last_undegraded":"2024-03-19T06:38:37.031845+0000","last_fullsized":"2024-03-19T06:38:37.031845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'9","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:05.371952+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:38:05.371952+0000","last_peered":"2024-03-19T06:38:05.371952+0000","last_clean":"2024-03-19T06:38:05.371952+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:38:05.371952+0000","last_undegraded":"2024-03-19T06:38:05.371952+0000","last_fullsized":"2024-03-19T06:38:05.371952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'66","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:05.388054+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:37:05.388054+0000","last_peered":"2024-03-19T06:37:05.388054+0000","last_clean":"2024-03-19T06:37:05.388054+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:37:05.388054+0000","last_undegraded":"2024-03-19T06:37:05.388054+0000","last_fullsized":"2024-03-19T06:37:05.388054+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:32:35.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173607+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:38:37.173607+0000","last_peered":"2024-03-19T06:38:37.173607+0000","last_clean":"2024-03-19T06:38:37.173607+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:38:37.173607+0000","last_undegraded":"2024-03-19T06:38:37.173607+0000","last_fullsized":"2024-03-19T06:38:37.173607+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:02:31.616910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:38.964088+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:37:38.964088+0000","last_peered":"2024-03-19T06:37:38.964088+0000","last_clean":"2024-03-19T06:37:38.964088+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:37:38.964088+0000","last_undegraded":"2024-03-19T06:37:38.964088+0000","last_fullsized":"2024-03-19T06:37:38.964088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:39:54.879583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'429","reported_seq":474,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:46.066792+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:37:46.066792+0000","last_peered":"2024-03-19T06:37:46.066792+0000","last_clean":"2024-03-19T06:37:46.066792+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:37:46.066792+0000","last_undegraded":"2024-03-19T06:37:46.066792+0000","last_fullsized":"2024-03-19T06:37:46.066792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:21:55.030303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'23","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174549+0000","last_change":"2024-03-19T06:06:34.341139+0000","last_active":"2024-03-19T06:38:37.174549+0000","last_peered":"2024-03-19T06:38:37.174549+0000","last_clean":"2024-03-19T06:38:37.174549+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:38:37.174549+0000","last_undegraded":"2024-03-19T06:38:37.174549+0000","last_fullsized":"2024-03-19T06:38:37.174549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:35:15.411346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'57","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:14.329186+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:37:14.329186+0000","last_peered":"2024-03-19T06:37:14.329186+0000","last_clean":"2024-03-19T06:37:14.329186+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:37:14.329186+0000","last_undegraded":"2024-03-19T06:37:14.329186+0000","last_fullsized":"2024-03-19T06:37:14.329186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:04:48.173662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'545","reported_seq":590,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.760870+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:38:10.760870+0000","last_peered":"2024-03-19T06:38:10.760870+0000","last_clean":"2024-03-19T06:38:10.760870+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:38:10.760870+0000","last_undegraded":"2024-03-19T06:38:10.760870+0000","last_fullsized":"2024-03-19T06:38:10.760870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:35.220771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.036645+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:38:37.036645+0000","last_peered":"2024-03-19T06:38:37.036645+0000","last_clean":"2024-03-19T06:38:37.036645+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:38:37.036645+0000","last_undegraded":"2024-03-19T06:38:37.036645+0000","last_fullsized":"2024-03-19T06:38:37.036645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:48:17.449711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'76","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:10.121030+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:37:10.121030+0000","last_peered":"2024-03-19T06:37:10.121030+0000","last_clean":"2024-03-19T06:37:10.121030+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:37:10.121030+0000","last_undegraded":"2024-03-19T06:37:10.121030+0000","last_fullsized":"2024-03-19T06:37:10.121030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:19:57.857432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'30","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266686+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:38:37.266686+0000","last_peered":"2024-03-19T06:38:37.266686+0000","last_clean":"2024-03-19T06:38:37.266686+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:38:37.266686+0000","last_undegraded":"2024-03-19T06:38:37.266686+0000","last_fullsized":"2024-03-19T06:38:37.266686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:59:59.421350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'25","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.117420+0000","last_change":"2024-03-19T06:06:34.544411+0000","last_active":"2024-03-19T06:38:37.117420+0000","last_peered":"2024-03-19T06:38:37.117420+0000","last_clean":"2024-03-19T06:38:37.117420+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:38:37.117420+0000","last_undegraded":"2024-03-19T06:38:37.117420+0000","last_fullsized":"2024-03-19T06:38:37.117420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:55:00.637128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'25","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116203+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:38:37.116203+0000","last_peered":"2024-03-19T06:38:37.116203+0000","last_clean":"2024-03-19T06:38:37.116203+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:38:37.116203+0000","last_undegraded":"2024-03-19T06:38:37.116203+0000","last_fullsized":"2024-03-19T06:38:37.116203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174107+0000","last_change":"2024-03-19T06:06:34.321660+0000","last_active":"2024-03-19T06:38:37.174107+0000","last_peered":"2024-03-19T06:38:37.174107+0000","last_clean":"2024-03-19T06:38:37.174107+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:38:37.174107+0000","last_undegraded":"2024-03-19T06:38:37.174107+0000","last_fullsized":"2024-03-19T06:38:37.174107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'17","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159101+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:38:37.159101+0000","last_peered":"2024-03-19T06:38:37.159101+0000","last_clean":"2024-03-19T06:38:37.159101+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:38:37.159101+0000","last_undegraded":"2024-03-19T06:38:37.159101+0000","last_fullsized":"2024-03-19T06:38:37.159101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030145+0000","last_change":"2024-03-19T06:06:34.587989+0000","last_active":"2024-03-19T06:38:37.030145+0000","last_peered":"2024-03-19T06:38:37.030145+0000","last_clean":"2024-03-19T06:38:37.030145+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:38:37.030145+0000","last_undegraded":"2024-03-19T06:38:37.030145+0000","last_fullsized":"2024-03-19T06:38:37.030145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'34","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.268767+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:38:37.268767+0000","last_peered":"2024-03-19T06:38:37.268767+0000","last_clean":"2024-03-19T06:38:37.268767+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:38:37.268767+0000","last_undegraded":"2024-03-19T06:38:37.268767+0000","last_fullsized":"2024-03-19T06:38:37.268767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:16:29.952714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'15","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.157048+0000","last_change":"2024-03-19T06:06:34.346593+0000","last_active":"2024-03-19T06:38:37.157048+0000","last_peered":"2024-03-19T06:38:37.157048+0000","last_clean":"2024-03-19T06:38:37.157048+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:38:37.157048+0000","last_undegraded":"2024-03-19T06:38:37.157048+0000","last_fullsized":"2024-03-19T06:38:37.157048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:46.931348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.024849+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:38:37.024849+0000","last_peered":"2024-03-19T06:38:37.024849+0000","last_clean":"2024-03-19T06:38:37.024849+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:38:37.024849+0000","last_undegraded":"2024-03-19T06:38:37.024849+0000","last_fullsized":"2024-03-19T06:38:37.024849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:14:30.308015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.156166+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:38:37.156166+0000","last_peered":"2024-03-19T06:38:37.156166+0000","last_clean":"2024-03-19T06:38:37.156166+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:38:37.156166+0000","last_undegraded":"2024-03-19T06:38:37.156166+0000","last_fullsized":"2024-03-19T06:38:37.156166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:46:36.817628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'24","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038453+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:38:37.038453+0000","last_peered":"2024-03-19T06:38:37.038453+0000","last_clean":"2024-03-19T06:38:37.038453+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:38:37.038453+0000","last_undegraded":"2024-03-19T06:38:37.038453+0000","last_fullsized":"2024-03-19T06:38:37.038453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'30","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174191+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:38:37.174191+0000","last_peered":"2024-03-19T06:38:37.174191+0000","last_clean":"2024-03-19T06:38:37.174191+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:38:37.174191+0000","last_undegraded":"2024-03-19T06:38:37.174191+0000","last_fullsized":"2024-03-19T06:38:37.174191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:00.375788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266242+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:38:37.266242+0000","last_peered":"2024-03-19T06:38:37.266242+0000","last_clean":"2024-03-19T06:38:37.266242+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:38:37.266242+0000","last_undegraded":"2024-03-19T06:38:37.266242+0000","last_fullsized":"2024-03-19T06:38:37.266242+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:21:50.701432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.997271+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:38:36.997271+0000","last_peered":"2024-03-19T06:38:36.997271+0000","last_clean":"2024-03-19T06:38:36.997271+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:38:36.997271+0000","last_undegraded":"2024-03-19T06:38:36.997271+0000","last_fullsized":"2024-03-19T06:38:36.997271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:40:13.759956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.112896+0000","last_change":"2024-03-19T06:06:34.525330+0000","last_active":"2024-03-19T06:38:37.112896+0000","last_peered":"2024-03-19T06:38:37.112896+0000","last_clean":"2024-03-19T06:38:37.112896+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:38:37.112896+0000","last_undegraded":"2024-03-19T06:38:37.112896+0000","last_fullsized":"2024-03-19T06:38:37.112896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:17.460914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.022733+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:38:37.022733+0000","last_peered":"2024-03-19T06:38:37.022733+0000","last_clean":"2024-03-19T06:38:37.022733+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:38:37.022733+0000","last_undegraded":"2024-03-19T06:38:37.022733+0000","last_fullsized":"2024-03-19T06:38:37.022733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:49.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.027476+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:38:37.027476+0000","last_peered":"2024-03-19T06:38:37.027476+0000","last_clean":"2024-03-19T06:38:37.027476+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:38:37.027476+0000","last_undegraded":"2024-03-19T06:38:37.027476+0000","last_fullsized":"2024-03-19T06:38:37.027476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:15:46.075359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.033006+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:38:37.033006+0000","last_peered":"2024-03-19T06:38:37.033006+0000","last_clean":"2024-03-19T06:38:37.033006+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:38:37.033006+0000","last_undegraded":"2024-03-19T06:38:37.033006+0000","last_fullsized":"2024-03-19T06:38:37.033006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:02:45.357019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173314+0000","last_change":"2024-03-19T06:06:34.586276+0000","last_active":"2024-03-19T06:38:37.173314+0000","last_peered":"2024-03-19T06:38:37.173314+0000","last_clean":"2024-03-19T06:38:37.173314+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:38:37.173314+0000","last_undegraded":"2024-03-19T06:38:37.173314+0000","last_fullsized":"2024-03-19T06:38:37.173314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'33","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032462+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:38:37.032462+0000","last_peered":"2024-03-19T06:38:37.032462+0000","last_clean":"2024-03-19T06:38:37.032462+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:38:37.032462+0000","last_undegraded":"2024-03-19T06:38:37.032462+0000","last_fullsized":"2024-03-19T06:38:37.032462+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:56:58.413061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037174+0000","last_change":"2024-03-19T06:06:34.351621+0000","last_active":"2024-03-19T06:38:37.037174+0000","last_peered":"2024-03-19T06:38:37.037174+0000","last_clean":"2024-03-19T06:38:37.037174+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:38:37.037174+0000","last_undegraded":"2024-03-19T06:38:37.037174+0000","last_fullsized":"2024-03-19T06:38:37.037174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:55:23.540138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.261481+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:38:37.261481+0000","last_peered":"2024-03-19T06:38:37.261481+0000","last_clean":"2024-03-19T06:38:37.261481+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:38:37.261481+0000","last_undegraded":"2024-03-19T06:38:37.261481+0000","last_fullsized":"2024-03-19T06:38:37.261481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:09:01.510298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'31","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.269944+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:38:37.269944+0000","last_peered":"2024-03-19T06:38:37.269944+0000","last_clean":"2024-03-19T06:38:37.269944+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:38:37.269944+0000","last_undegraded":"2024-03-19T06:38:37.269944+0000","last_fullsized":"2024-03-19T06:38:37.269944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:50:56.973846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'28","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.038936+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:38:37.038936+0000","last_peered":"2024-03-19T06:38:37.038936+0000","last_clean":"2024-03-19T06:38:37.038936+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:38:37.038936+0000","last_undegraded":"2024-03-19T06:38:37.038936+0000","last_fullsized":"2024-03-19T06:38:37.038936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160816+0000","last_change":"2024-03-19T06:06:34.542536+0000","last_active":"2024-03-19T06:38:37.160816+0000","last_peered":"2024-03-19T06:38:37.160816+0000","last_clean":"2024-03-19T06:38:37.160816+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:38:37.160816+0000","last_undegraded":"2024-03-19T06:38:37.160816+0000","last_fullsized":"2024-03-19T06:38:37.160816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:06:36.062933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'17","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.985994+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:38:36.985994+0000","last_peered":"2024-03-19T06:38:36.985994+0000","last_clean":"2024-03-19T06:38:36.985994+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:38:36.985994+0000","last_undegraded":"2024-03-19T06:38:36.985994+0000","last_fullsized":"2024-03-19T06:38:36.985994+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.455516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115360+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:38:37.115360+0000","last_peered":"2024-03-19T06:38:37.115360+0000","last_clean":"2024-03-19T06:38:37.115360+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:38:37.115360+0000","last_undegraded":"2024-03-19T06:38:37.115360+0000","last_fullsized":"2024-03-19T06:38:37.115360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:45:02.008349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'22","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.002299+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:38:37.002299+0000","last_peered":"2024-03-19T06:38:37.002299+0000","last_clean":"2024-03-19T06:38:37.002299+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:38:37.002299+0000","last_undegraded":"2024-03-19T06:38:37.002299+0000","last_fullsized":"2024-03-19T06:38:37.002299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:41:16.041054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085837+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:38:37.085837+0000","last_peered":"2024-03-19T06:38:37.085837+0000","last_clean":"2024-03-19T06:38:37.085837+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:38:37.085837+0000","last_undegraded":"2024-03-19T06:38:37.085837+0000","last_fullsized":"2024-03-19T06:38:37.085837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:12:31.901447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'24","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.166927+0000","last_change":"2024-03-19T06:06:34.523610+0000","last_active":"2024-03-19T06:38:37.166927+0000","last_peered":"2024-03-19T06:38:37.166927+0000","last_clean":"2024-03-19T06:38:37.166927+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:38:37.166927+0000","last_undegraded":"2024-03-19T06:38:37.166927+0000","last_fullsized":"2024-03-19T06:38:37.166927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:13:28.994008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.023949+0000","last_change":"2024-03-19T06:06:34.587688+0000","last_active":"2024-03-19T06:38:37.023949+0000","last_peered":"2024-03-19T06:38:37.023949+0000","last_clean":"2024-03-19T06:38:37.023949+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:38:37.023949+0000","last_undegraded":"2024-03-19T06:38:37.023949+0000","last_fullsized":"2024-03-19T06:38:37.023949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:24:57.834130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'19","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.115848+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:38:37.115848+0000","last_peered":"2024-03-19T06:38:37.115848+0000","last_clean":"2024-03-19T06:38:37.115848+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:38:37.115848+0000","last_undegraded":"2024-03-19T06:38:37.115848+0000","last_fullsized":"2024-03-19T06:38:37.115848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:47:48.262951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2145,"num_write_kb":250125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2307,"ondisk_log_size":2307,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1476,"ondisk_log_size":1476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22012001,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":7122,"num_write_kb":24983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44269568,"data_stored":44024002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5503,"ondisk_log_size":5503,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477133,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":13553664,"data_stored":13317561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719477132,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39876,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331964,"statfs":{"total":96636764160,"available":96595931136,"internally_reserved":0,"allocated":389120,"data_stored":146113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477131,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":8753152,"data_stored":8532119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477131,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":9564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":9793536,"data_stored":9563926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509835,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39724,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332116,"statfs":{"total":96636764160,"available":96596086784,"internally_reserved":0,"allocated":8753152,"data_stored":8532251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509835,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":260733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509835,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":143131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509835,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":5932,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":6074368,"data_stored":5841696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5140480,"data_stored":5109729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":119134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9422327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:38:45.703 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:38:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.962+0000 7f6028a00640 1 Processor -- start 2024-03-19T06:38:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.962+0000 7f6028a00640 1 -- start start 2024-03-19T06:38:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.964+0000 7f6028a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 0x7f6024161f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.964+0000 7f6028a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f602415e8d0 0x7f60241687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.964+0000 7f6028a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6024072070 con 0x7f6024158330 2024-03-19T06:38:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.964+0000 7f6028a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240c8c90 con 0x7f602415e8d0 2024-03-19T06:38:45.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.964+0000 7f6028a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240c5120 con 0x7f60240c7ce0 2024-03-19T06:38:45.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.966+0000 7f6023200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f602415e8d0 0x7f60241687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.973+0000 7f6019e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 0x7f6024161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:45.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.974+0000 7f6019e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 0x7f6024161f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:38776/0 (socket says 172.21.15.17:38776) 2024-03-19T06:38:45.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:45.974+0000 7f6019e00640 1 -- 172.21.15.17:0/1114470446 learned_addr learned my addr 172.21.15.17:0/1114470446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.024+0000 7f6023200640 1 -- 172.21.15.17:0/1114470446 >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 msgr2=0x7f6024161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.024+0000 7f6023200640 1 --2- 172.21.15.17:0/1114470446 >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 0x7f6024161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.024+0000 7f6023200640 1 -- 172.21.15.17:0/1114470446 >> v1:172.21.15.17:6789/0 conn(0x7f6024158330 legacy=0x7f6024071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.024+0000 7f6023200640 1 -- 172.21.15.17:0/1114470446 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240c5370 con 0x7f602415e8d0 2024-03-19T06:38:46.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.028+0000 7f6023200640 1 --2- 172.21.15.17:0/1114470446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241687d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6024070100 tx=0x7f601c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366d22d2945e8379 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.045+0000 7f6021e00640 1 -- 172.21.15.17:0/1114470446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c035020 con 0x7f602415e8d0 2024-03-19T06:38:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.045+0000 7f6021e00640 1 -- 172.21.15.17:0/1114470446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c031830 con 0x7f602415e8d0 2024-03-19T06:38:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.045+0000 7f6021e00640 1 -- 172.21.15.17:0/1114470446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c031c00 con 0x7f602415e8d0 2024-03-19T06:38:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 -- 172.21.15.17:0/1114470446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 msgr2=0x7f60241687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 --2- 172.21.15.17:0/1114470446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241687d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6024070100 tx=0x7f601c02b8d0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 -- 172.21.15.17:0/1114470446 shutdown_connections 2024-03-19T06:38:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 --2- 172.21.15.17:0/1114470446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241687d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 --2- 172.21.15.17:0/1114470446 >> v2:172.21.15.153:3300/0 conn(0x7f60240c7ce0 0x7f6024161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 -- 172.21.15.17:0/1114470446 >> 172.21.15.17:0/1114470446 conn(0x7f602406e630 msgr2=0x7f602406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 -- 172.21.15.17:0/1114470446 shutdown_connections 2024-03-19T06:38:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.047+0000 7f6028a00640 1 -- 172.21.15.17:0/1114470446 wait complete. 2024-03-19T06:38:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.050+0000 7f6028a00640 1 Processor -- start 2024-03-19T06:38:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.050+0000 7f6028a00640 1 -- start start 2024-03-19T06:38:46.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.051+0000 7f6028a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60240c7ce0 0x7f60241f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.051+0000 7f6028a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6024158330 0x7f60241e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.051+0000 7f6028a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.051+0000 7f6028a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024161a00 con 0x7f602415e8d0 2024-03-19T06:38:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.051+0000 7f6028a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024161720 con 0x7f6024158330 2024-03-19T06:38:46.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.052+0000 7f6028a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602415ed00 con 0x7f60240c7ce0 2024-03-19T06:38:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.052+0000 7f6023200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.053+0000 7f6023200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60380/0 (socket says 172.21.15.17:60380) 2024-03-19T06:38:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.053+0000 7f6023200640 1 -- 172.21.15.17:0/2209958102 learned_addr learned my addr 172.21.15.17:0/2209958102 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.057+0000 7f6023200640 1 -- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60240c7ce0 msgr2=0x7f60241f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.057+0000 7f6023200640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60240c7ce0 0x7f60241f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.057+0000 7f6023200640 1 -- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6024158330 msgr2=0x7f60241e6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.057+0000 7f6023200640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6024158330 0x7f60241e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.057+0000 7f6023200640 1 -- 172.21.15.17:0/2209958102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024158860 con 0x7f602415e8d0 2024-03-19T06:38:46.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.060+0000 7f6023200640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f601c034040 tx=0x7f601c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.064+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c040070 con 0x7f602415e8d0 2024-03-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.064+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602415a580 con 0x7f602415e8d0 2024-03-19T06:38:46.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.064+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024158db0 con 0x7f602415e8d0 2024-03-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.065+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240686e0 con 0x7f602415e8d0 2024-03-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.066+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c031830 con 0x7f602415e8d0 2024-03-19T06:38:46.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.066+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c052060 con 0x7f602415e8d0 2024-03-19T06:38:46.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.379+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f601c038020 con 0x7f602415e8d0 2024-03-19T06:38:46.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.381+0000 7f601b400640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 0x7f600006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:46.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.382+0000 7f6022800640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 0x7f600006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:46.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.384+0000 7f6022800640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 0x7f600006e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6014000f60 tx=0x7f60140079d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:46.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.398+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f601c078cd0 con 0x7f602415e8d0 2024-03-19T06:38:46.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.399+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f601c07b330 con 0x7f602415e8d0 2024-03-19T06:38:46.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.616+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60240cc0d0 con 0x7f602415e8d0 2024-03-19T06:38:46.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.701+0000 7f601b400640 1 -- 172.21.15.17:0/2209958102 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f601c07ac30 con 0x7f602415e8d0 2024-03-19T06:38:46.687 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:46.687 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.704+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 msgr2=0x7f600006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.704+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 0x7f600006e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6014000f60 tx=0x7f60140079d0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.704+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 msgr2=0x7f60241f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.704+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f601c034040 tx=0x7f601c0046c0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 shutdown_connections 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f602415e8d0 0x7f60241f77d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f600006bbd0 0x7f600006e090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6024158330 0x7f60241e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 --2- 172.21.15.17:0/2209958102 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f60240c7ce0 0x7f60241f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:46.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 >> 172.21.15.17:0/2209958102 conn(0x7f602406e630 msgr2=0x7f6024157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 shutdown_connections 2024-03-19T06:38:46.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:46.705+0000 7f6028a00640 1 -- 172.21.15.17:0/2209958102 wait complete. 2024-03-19T06:38:47.714 INFO:tasks.ceph:Scrubbing osd.0 2024-03-19T06:38:47.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:47.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.955+0000 7f631ea00640 1 Processor -- start 2024-03-19T06:38:47.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.955+0000 7f631ea00640 1 -- start start 2024-03-19T06:38:47.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.957+0000 7f631ea00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f63180c76c0 0x7f6318157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.957+0000 7f631ea00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631815e250 con 0x7f631806ccb0 2024-03-19T06:38:47.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.957+0000 7f631ea00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63180c69b0 con 0x7f631806d090 2024-03-19T06:38:47.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.957+0000 7f631ea00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631815f290 con 0x7f63180c76c0 2024-03-19T06:38:47.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.958+0000 7f6317e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f631806ccb0 0x7f6318162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38744/0 (socket says 172.21.15.17:38744) 2024-03-19T06:38:47.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.958+0000 7f6317e00640 1 -- 172.21.15.17:0/2630071689 learned_addr learned my addr 172.21.15.17:0/2630071689 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:47.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.961+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119683669 0 0) 0x7f6308001110 con 0x7f631806ccb0 2024-03-19T06:38:47.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.961+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62fc003520 con 0x7f631806ccb0 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267490643 0 0) 0x7f62fc003520 con 0x7f631806ccb0 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 >> v2:172.21.15.153:3300/0 conn(0x7f63180c76c0 msgr2=0x7f6318157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 --2- 172.21.15.17:0/2630071689 >> v2:172.21.15.153:3300/0 conn(0x7f63180c76c0 0x7f6318157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 >> v1:172.21.15.153:6789/0 conn(0x7f631806d090 legacy=0x7f6318070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631815e4d0 con 0x7f631806ccb0 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f6308001840 con 0x7f631806ccb0 2024-03-19T06:38:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 >> v1:172.21.15.17:6789/0 conn(0x7f631806ccb0 legacy=0x7f6318162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 0x7f62fc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62fc004800 0x7f62fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc0052e0 0x7f62fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631815f290 con 0x7f62fc003a00 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc00c220 con 0x7f62fc0052e0 2024-03-19T06:38:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.966+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62fc00c420 con 0x7f62fc004800 2024-03-19T06:38:47.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.969+0000 7f6317e00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 0x7f62fc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f6317e00640 1 -- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62fc004800 msgr2=0x7f62fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f6317e00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f62fc004800 0x7f62fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f6317e00640 1 -- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc0052e0 msgr2=0x7f62fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f6317e00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62fc0052e0 0x7f62fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f6317e00640 1 -- 172.21.15.17:0/2630071689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc003520 con 0x7f62fc003a00 2024-03-19T06:38:47.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.973+0000 7f631ca00640 1 -- 172.21.15.17:0/2630071689 reap_dead start 2024-03-19T06:38:47.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.975+0000 7f6317e00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 0x7f62fc003e00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f630800c2f0 tx=0x7f62fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619c37e7a7c54bc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.984+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308007e10 con 0x7f62fc003a00 2024-03-19T06:38:47.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.985+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308030070 con 0x7f62fc003a00 2024-03-19T06:38:47.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.985+0000 7f6317400640 1 -- 172.21.15.17:0/2630071689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080058d0 con 0x7f62fc003a00 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 -- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 msgr2=0x7f62fc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 0x7f62fc003e00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f630800c2f0 tx=0x7f62fc005830 comp rx=0 tx=0).stop 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 -- 172.21.15.17:0/2630071689 shutdown_connections 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 --2- 172.21.15.17:0/2630071689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62fc003a00 0x7f62fc003e00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 -- 172.21.15.17:0/2630071689 >> 172.21.15.17:0/2630071689 conn(0x7f631806b020 msgr2=0x7f631806b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 -- 172.21.15.17:0/2630071689 shutdown_connections 2024-03-19T06:38:47.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.986+0000 7f631ea00640 1 -- 172.21.15.17:0/2630071689 wait complete. 2024-03-19T06:38:47.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.989+0000 7f631ea00640 1 Processor -- start 2024-03-19T06:38:47.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.989+0000 7f631ea00640 1 -- start start 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815d6e0 0x7f6318153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 0x7f63181e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815dac0 0x7f63181f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631815ed70 con 0x7f63181553b0 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631815ea90 con 0x7f631815dac0 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.991+0000 7f631ea00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63180c6450 con 0x7f631815d6e0 2024-03-19T06:38:47.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.992+0000 7f630f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 0x7f63181e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:47.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.992+0000 7f630f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 0x7f63181e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60406/0 (socket says 172.21.15.17:60406) 2024-03-19T06:38:47.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.992+0000 7f630f400640 1 -- 172.21.15.17:0/2664773712 learned_addr learned my addr 172.21.15.17:0/2664773712 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:47.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.992+0000 7f6317e00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815d6e0 0x7f6318153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:47.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.996+0000 7f630f400640 1 -- 172.21.15.17:0/2664773712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815d6e0 msgr2=0x7f6318153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.996+0000 7f630f400640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f631815d6e0 0x7f6318153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.996+0000 7f630f400640 1 -- 172.21.15.17:0/2664773712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815dac0 msgr2=0x7f63181f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.996+0000 7f630f400640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f631815dac0 0x7f63181f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:47.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:47.996+0000 7f630f400640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63181e7f60 con 0x7f63181553b0 2024-03-19T06:38:47.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.005+0000 7f630f400640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 0x7f63181e7820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f630000c440 tx=0x7f630000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.053+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300017070 con 0x7f63181553b0 2024-03-19T06:38:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.053+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63000035f0 con 0x7f63181553b0 2024-03-19T06:38:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.053+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63000039e0 con 0x7f63181553b0 2024-03-19T06:38:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.053+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63181e8240 con 0x7f63181553b0 2024-03-19T06:38:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.053+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63181f7ec0 con 0x7f63181553b0 2024-03-19T06:38:48.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.054+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6318069be0 con 0x7f63181553b0 2024-03-19T06:38:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.119+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f630001a070 con 0x7f63181553b0 2024-03-19T06:38:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.121+0000 7f6314c00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62f406bc20 0x7f62f406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.122+0000 7f6317e00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62f406bc20 0x7f62f406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.124+0000 7f6317e00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62f406bc20 0x7f62f406e0e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6308034000 tx=0x7f6308007000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.133+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6300056a70 con 0x7f63181553b0 2024-03-19T06:38:48.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.134+0000 7f6314c00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f62f4075640 0x7f62f4077ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.134+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f630000ae50 con 0x7f62f4075640 2024-03-19T06:38:48.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.134+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6300054c70 con 0x7f63181553b0 2024-03-19T06:38:48.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.134+0000 7f631ca00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f62f4075640 0x7f62f4077ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.136+0000 7f631ca00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f62f4075640 0x7f62f4077ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.138+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== osd.0 v2:172.21.15.17:6816/3775910215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f630000ae50 con 0x7f62f4075640 2024-03-19T06:38:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.160+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 --> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f631815c3d0 con 0x7f62f4075640 2024-03-19T06:38:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.161+0000 7f6314c00640 1 -- 172.21.15.17:0/2664773712 <== osd.0 v2:172.21.15.17:6816/3775910215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f631815c3d0 con 0x7f62f4075640 2024-03-19T06:38:48.147 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:48.147 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:48.147 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.162+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f62f4075640 msgr2=0x7f62f4077ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.162+0000 7f631ea00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6816/3775910215,v1:172.21.15.17:6817/3775910215] conn(0x7f62f4075640 0x7f62f4077ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62f406bc20 msgr2=0x7f62f406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f62f406bc20 0x7f62f406e0e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6308034000 tx=0x7f6308007000 comp rx=0 tx=0).stop 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 msgr2=0x7f63181e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 --2- 172.21.15.17:0/2664773712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63181553b0 0x7f63181e7820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f630000c440 tx=0x7f630000c900 comp rx=0 tx=0).stop 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ca00640 1 -- 172.21.15.17:0/2664773712 reap_dead start 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 shutdown_connections 2024-03-19T06:38:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 >> 172.21.15.17:0/2664773712 conn(0x7f631806b020 msgr2=0x7f631806b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 shutdown_connections 2024-03-19T06:38:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.163+0000 7f631ea00640 1 -- 172.21.15.17:0/2664773712 wait complete. 2024-03-19T06:38:48.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-19T06:38:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.406+0000 7efc36200640 1 Processor -- start 2024-03-19T06:38:48.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.406+0000 7efc36200640 1 -- start start 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.408+0000 7efc36200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efc30151cb0 0x7efc3006d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.408+0000 7efc36200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc3006cee0 0x7efc3006dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.408+0000 7efc36200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc300c5c50 con 0x7efc3015af90 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.408+0000 7efc36200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300c5ef0 con 0x7efc3006cee0 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.408+0000 7efc36200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300718f0 con 0x7efc30151cb0 2024-03-19T06:38:48.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.409+0000 7efc2fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc3006cee0 0x7efc3006dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.409+0000 7efc2fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efc3006cee0 0x7efc3006dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60408/0 (socket says 172.21.15.17:60408) 2024-03-19T06:38:48.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.409+0000 7efc2fe00640 1 -- 172.21.15.17:0/2539591301 learned_addr learned my addr 172.21.15.17:0/2539591301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:48.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.411+0000 7efc34e00640 1 --2- 172.21.15.17:0/2539591301 >> v2:172.21.15.153:3300/0 conn(0x7efc30151cb0 0x7efc3006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.412+0000 7efc2fe00640 1 -- 172.21.15.17:0/2539591301 >> v2:172.21.15.153:3300/0 conn(0x7efc30151cb0 msgr2=0x7efc3006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:48.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.412+0000 7efc2fe00640 1 --2- 172.21.15.17:0/2539591301 >> v2:172.21.15.153:3300/0 conn(0x7efc30151cb0 0x7efc3006d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.412+0000 7efc2fe00640 1 -- 172.21.15.17:0/2539591301 >> v1:172.21.15.153:6789/0 conn(0x7efc3015af90 legacy=0x7efc3015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:48.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.412+0000 7efc2fe00640 1 -- 172.21.15.17:0/2539591301 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc30071bd0 con 0x7efc3006cee0 2024-03-19T06:38:48.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.414+0000 7efc2fe00640 1 --2- 172.21.15.17:0/2539591301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3006dd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc30074820 tx=0x7efc1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65393d3d0ce39ab5 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.420+0000 7efc2f400640 1 -- 172.21.15.17:0/2539591301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c034070 con 0x7efc3006cee0 2024-03-19T06:38:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.420+0000 7efc2f400640 1 -- 172.21.15.17:0/2539591301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c030860 con 0x7efc3006cee0 2024-03-19T06:38:48.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.420+0000 7efc2f400640 1 -- 172.21.15.17:0/2539591301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c030c30 con 0x7efc3006cee0 2024-03-19T06:38:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 -- 172.21.15.17:0/2539591301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 msgr2=0x7efc3006dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 --2- 172.21.15.17:0/2539591301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3006dd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc30074820 tx=0x7efc1c02b9a0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 -- 172.21.15.17:0/2539591301 shutdown_connections 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 --2- 172.21.15.17:0/2539591301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3006dd90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 --2- 172.21.15.17:0/2539591301 >> v2:172.21.15.153:3300/0 conn(0x7efc30151cb0 0x7efc3006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.421+0000 7efc36200640 1 -- 172.21.15.17:0/2539591301 >> 172.21.15.17:0/2539591301 conn(0x7efc3006e630 msgr2=0x7efc3006ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.422+0000 7efc36200640 1 -- 172.21.15.17:0/2539591301 shutdown_connections 2024-03-19T06:38:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.422+0000 7efc36200640 1 -- 172.21.15.17:0/2539591301 wait complete. 2024-03-19T06:38:48.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.424+0000 7efc36200640 1 Processor -- start 2024-03-19T06:38:48.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.425+0000 7efc36200640 1 -- start start 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc30151cb0 0x7efc30153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3015af90 0x7efc300ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc300c61d0 con 0x7efc3006cee0 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30072190 con 0x7efc3015af90 2024-03-19T06:38:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.426+0000 7efc36200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3006f150 con 0x7efc30151cb0 2024-03-19T06:38:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.427+0000 7efc34e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.427+0000 7efc34e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60410/0 (socket says 172.21.15.17:60410) 2024-03-19T06:38:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.427+0000 7efc34e00640 1 -- 172.21.15.17:0/844268779 learned_addr learned my addr 172.21.15.17:0/844268779 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.428+0000 7efc2fe00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc30151cb0 0x7efc30153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.428+0000 7efc35800640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3015af90 0x7efc300ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.431+0000 7efc34e00640 1 -- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc30151cb0 msgr2=0x7efc30153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.431+0000 7efc34e00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc30151cb0 0x7efc30153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.431+0000 7efc34e00640 1 -- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3015af90 msgr2=0x7efc300ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.431+0000 7efc34e00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3015af90 0x7efc300ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.431+0000 7efc34e00640 1 -- 172.21.15.17:0/844268779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc301523f0 con 0x7efc3006cee0 2024-03-19T06:38:48.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.434+0000 7efc34e00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c820 tx=0x7efc2400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.440+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24015070 con 0x7efc3006cee0 2024-03-19T06:38:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.440+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24004240 con 0x7efc3006cee0 2024-03-19T06:38:48.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.440+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc30154b00 con 0x7efc3006cee0 2024-03-19T06:38:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.440+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400ce10 con 0x7efc3006cee0 2024-03-19T06:38:48.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.441+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3014dd10 con 0x7efc3006cee0 2024-03-19T06:38:48.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.442+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc300686e0 con 0x7efc3006cee0 2024-03-19T06:38:48.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.753+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7efc24007830 con 0x7efc3006cee0 2024-03-19T06:38:48.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.754+0000 7efc2cc00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 0x7efc1006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:48.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.755+0000 7efc2fe00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 0x7efc1006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:48.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.757+0000 7efc2fe00640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 0x7efc1006e110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc1c036000 tx=0x7efc1c008030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:48.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.794+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efc240571e0 con 0x7efc3006cee0 2024-03-19T06:38:48.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:48.795+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7efc24059140 con 0x7efc3006cee0 2024-03-19T06:38:48.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.009+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7efc30152190 con 0x7efc1006bc50 2024-03-19T06:38:48.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.010+0000 7efc2cc00640 1 -- 172.21.15.17:0/844268779 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc1c030a20 con 0x7efc1006bc50 2024-03-19T06:38:48.996 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 msgr2=0x7efc1006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 0x7efc1006e110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc1c036000 tx=0x7efc1c008030 comp rx=0 tx=0).stop 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 msgr2=0x7efc3014e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c820 tx=0x7efc2400cce0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 shutdown_connections 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7efc1006bc50 0x7efc1006e110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc3015af90 0x7efc300ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7efc30151cb0 0x7efc30153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:48.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 --2- 172.21.15.17:0/844268779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc3006cee0 0x7efc3014e230 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.013+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 >> 172.21.15.17:0/844268779 conn(0x7efc3006e630 msgr2=0x7efc30144a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.014+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 shutdown_connections 2024-03-19T06:38:49.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.014+0000 7efc36200640 1 -- 172.21.15.17:0/844268779 wait complete. 2024-03-19T06:38:49.018 INFO:tasks.ceph:Scrubbing osd.1 2024-03-19T06:38:49.018 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.250+0000 7f375d800640 1 Processor -- start 2024-03-19T06:38:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.250+0000 7f375d800640 1 -- start start 2024-03-19T06:38:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f375d800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37580c27c0 0x7f375806ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f375d800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580721c0 con 0x7f375806cf80 2024-03-19T06:38:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f375d800640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580c2f20 con 0x7f3758150ea0 2024-03-19T06:38:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f375d800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3758151280 con 0x7f37580c27c0 2024-03-19T06:38:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f3757400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f375806cf80 0x7f3758157020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38758/0 (socket says 172.21.15.17:38758) 2024-03-19T06:38:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.252+0000 7f3757400640 1 -- 172.21.15.17:0/2465726027 learned_addr learned my addr 172.21.15.17:0/2465726027 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.255+0000 7f3756000640 1 --2- 172.21.15.17:0/2465726027 >> v2:172.21.15.153:3300/0 conn(0x7f37580c27c0 0x7f375806ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.256+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586346490 0 0) 0x7f37580721c0 con 0x7f375806cf80 2024-03-19T06:38:49.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.256+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c005730 con 0x7f375806cf80 2024-03-19T06:38:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2043330250 0 0) 0x7f373c005730 con 0x7f375806cf80 2024-03-19T06:38:49.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 >> v2:172.21.15.153:3300/0 conn(0x7f37580c27c0 msgr2=0x7f375806ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 --2- 172.21.15.17:0/2465726027 >> v2:172.21.15.153:3300/0 conn(0x7f37580c27c0 0x7f375806ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 >> v1:172.21.15.153:6789/0 conn(0x7f3758150ea0 legacy=0x7f3758071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758072880 con 0x7f375806cf80 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f37500019f0 con 0x7f375806cf80 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 >> v1:172.21.15.17:6789/0 conn(0x7f375806cf80 legacy=0x7f3758157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f373c005c10 0x7f373c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f373c006570 0x7f373c006a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f373c00ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758151280 con 0x7f373c007230 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c010570 con 0x7f373c005c10 2024-03-19T06:38:49.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.260+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c010770 con 0x7f373c006570 2024-03-19T06:38:49.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.263+0000 7f3756000640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f373c006570 0x7f373c006a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.263+0000 7f3757400640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f373c00ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.266+0000 7f3757400640 1 -- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f373c006570 msgr2=0x7f373c006a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.266+0000 7f3757400640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f373c006570 0x7f373c006a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.266+0000 7f3757400640 1 -- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f373c005c10 msgr2=0x7f373c006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.266+0000 7f3757400640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f373c005c10 0x7f373c006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.266+0000 7f3757400640 1 -- 172.21.15.17:0/2465726027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c005730 con 0x7f373c007230 2024-03-19T06:38:49.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.267+0000 7f3757400640 1 -- 172.21.15.17:0/2465726027 reap_dead start 2024-03-19T06:38:49.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.268+0000 7f3757400640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f373c00ffd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f375000a790 tx=0x7f373c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a657dfff0d0b851 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.272+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375000a3b0 con 0x7f373c007230 2024-03-19T06:38:49.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.272+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3750034670 con 0x7f373c007230 2024-03-19T06:38:49.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.272+0000 7f3755600640 1 -- 172.21.15.17:0/2465726027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3750034a60 con 0x7f373c007230 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 -- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 msgr2=0x7f373c00ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f373c00ffd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f375000a790 tx=0x7f373c007a40 comp rx=0 tx=0).stop 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 -- 172.21.15.17:0/2465726027 shutdown_connections 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 --2- 172.21.15.17:0/2465726027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f373c00ffd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 -- 172.21.15.17:0/2465726027 >> 172.21.15.17:0/2465726027 conn(0x7f375806b020 msgr2=0x7f375806b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 -- 172.21.15.17:0/2465726027 shutdown_connections 2024-03-19T06:38:49.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.273+0000 7f375d800640 1 -- 172.21.15.17:0/2465726027 wait complete. 2024-03-19T06:38:49.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.275+0000 7f375d800640 1 Processor -- start 2024-03-19T06:38:49.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.275+0000 7f375d800640 1 -- start start 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f3758155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37581430a0 0x7f37580ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3758150200 0x7f375813ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758072630 con 0x7f373c007230 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758072e40 con 0x7f3758150200 2024-03-19T06:38:49.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.276+0000 7f375d800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37580c2c10 con 0x7f37581430a0 2024-03-19T06:38:49.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.277+0000 7f3756a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f3758155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.277+0000 7f3756a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f3758155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60430/0 (socket says 172.21.15.17:60430) 2024-03-19T06:38:49.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.277+0000 7f3756a00640 1 -- 172.21.15.17:0/346458812 learned_addr learned my addr 172.21.15.17:0/346458812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:49.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.279+0000 7f3756000640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37581430a0 0x7f37580ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.282+0000 7f3756a00640 1 -- 172.21.15.17:0/346458812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37581430a0 msgr2=0x7f37580ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.282+0000 7f3756a00640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f37581430a0 0x7f37580ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.282+0000 7f3756a00640 1 -- 172.21.15.17:0/346458812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3758150200 msgr2=0x7f375813ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.282+0000 7f3756a00640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3758150200 0x7f375813ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.282+0000 7f3756a00640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758154a10 con 0x7f373c007230 2024-03-19T06:38:49.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.284+0000 7f3756a00640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f3758155810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f374800c560 tx=0x7f374800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.289+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480052d0 con 0x7f373c007230 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.289+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748012630 con 0x7f373c007230 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.289+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480054b0 con 0x7f373c007230 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.289+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3758156670 con 0x7f373c007230 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.290+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3758155d50 con 0x7f373c007230 2024-03-19T06:38:49.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.291+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37580677a0 con 0x7f373c007230 2024-03-19T06:38:49.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.317+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3748012a20 con 0x7f373c007230 2024-03-19T06:38:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.318+0000 7f374ea00640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f373406bc20 0x7f373406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.319+0000 7f3756000640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f373406bc20 0x7f373406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.320+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3748057640 con 0x7f373c007230 2024-03-19T06:38:49.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.320+0000 7f374ea00640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7f37340756c0 0x7f3734077b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.320+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3734078230 con 0x7f37340756c0 2024-03-19T06:38:49.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.320+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3748055840 con 0x7f373c007230 2024-03-19T06:38:49.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.320+0000 7f3756000640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f373406bc20 0x7f373406e0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37581508b0 tx=0x7f3740008040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.321+0000 7f3757400640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7f37340756c0 0x7f3734077b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.322+0000 7f3757400640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7f37340756c0 0x7f3734077b60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.324+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== osd.1 v2:172.21.15.17:6818/872185476 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3734078230 con 0x7f37340756c0 2024-03-19T06:38:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.342+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 --> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3758069be0 con 0x7f37340756c0 2024-03-19T06:38:49.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.342+0000 7f374ea00640 1 -- 172.21.15.17:0/346458812 <== osd.1 v2:172.21.15.17:6818/872185476 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3758069be0 con 0x7f37340756c0 2024-03-19T06:38:49.327 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:49.328 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7f37340756c0 msgr2=0x7f3734077b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6818/872185476,v1:172.21.15.17:6820/872185476] conn(0x7f37340756c0 0x7f3734077b60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f373406bc20 msgr2=0x7f373406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f373406bc20 0x7f373406e0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f37581508b0 tx=0x7f3740008040 comp rx=0 tx=0).stop 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 msgr2=0x7f3758155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 --2- 172.21.15.17:0/346458812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f373c007230 0x7f3758155810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f374800c560 tx=0x7f374800ca20 comp rx=0 tx=0).stop 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f3757400640 1 -- 172.21.15.17:0/346458812 reap_dead start 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 shutdown_connections 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 >> 172.21.15.17:0/346458812 conn(0x7f375806b020 msgr2=0x7f3758142000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.343+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 shutdown_connections 2024-03-19T06:38:49.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.344+0000 7f375d800640 1 -- 172.21.15.17:0/346458812 wait complete. 2024-03-19T06:38:49.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-19T06:38:49.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.590+0000 7fdab7200640 1 Processor -- start 2024-03-19T06:38:49.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.590+0000 7fdab7200640 1 -- start start 2024-03-19T06:38:49.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.591+0000 7fdab7200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdab015b6a0 0x7fdab0163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.592+0000 7fdab7200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00c5c50 con 0x7fdab0151cb0 2024-03-19T06:38:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.592+0000 7fdab7200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab00c5ef0 con 0x7fdab00c8810 2024-03-19T06:38:49.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.592+0000 7fdab7200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab00718f0 con 0x7fdab015b6a0 2024-03-19T06:38:49.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.593+0000 7fdab6800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdab015b6a0 0x7fdab0163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.593+0000 7fdab5400640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdab00c8810 0x7fdab015af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:52978/0 (socket says 172.21.15.17:52978) 2024-03-19T06:38:49.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.593+0000 7fdab5400640 1 -- 172.21.15.17:0/3006630420 learned_addr learned my addr 172.21.15.17:0/3006630420 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.597+0000 7fdab6800640 1 -- 172.21.15.17:0/3006630420 >> v1:172.21.15.153:6789/0 conn(0x7fdab00c8810 legacy=0x7fdab015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.597+0000 7fdab6800640 1 -- 172.21.15.17:0/3006630420 >> v1:172.21.15.17:6789/0 conn(0x7fdab0151cb0 legacy=0x7fdab006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.597+0000 7fdab6800640 1 -- 172.21.15.17:0/3006630420 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0071bd0 con 0x7fdab015b6a0 2024-03-19T06:38:49.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.601+0000 7fdab6800640 1 --2- 172.21.15.17:0/3006630420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab0163230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009d90 tx=0x7fdaac02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb5bbede1b4710e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.607+0000 7fdab4a00640 1 -- 172.21.15.17:0/3006630420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac039070 con 0x7fdab015b6a0 2024-03-19T06:38:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.607+0000 7fdab4a00640 1 -- 172.21.15.17:0/3006630420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac02cd80 con 0x7fdab015b6a0 2024-03-19T06:38:49.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.607+0000 7fdab4a00640 1 -- 172.21.15.17:0/3006630420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac034660 con 0x7fdab015b6a0 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.607+0000 7fdab7200640 1 -- 172.21.15.17:0/3006630420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 msgr2=0x7fdab0163230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.607+0000 7fdab7200640 1 --2- 172.21.15.17:0/3006630420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab0163230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009d90 tx=0x7fdaac02bfd0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.608+0000 7fdab7200640 1 -- 172.21.15.17:0/3006630420 shutdown_connections 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.608+0000 7fdab7200640 1 --2- 172.21.15.17:0/3006630420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab0163230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.608+0000 7fdab7200640 1 -- 172.21.15.17:0/3006630420 >> 172.21.15.17:0/3006630420 conn(0x7fdab006e630 msgr2=0x7fdab006ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.608+0000 7fdab7200640 1 -- 172.21.15.17:0/3006630420 shutdown_connections 2024-03-19T06:38:49.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.608+0000 7fdab7200640 1 -- 172.21.15.17:0/3006630420 wait complete. 2024-03-19T06:38:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.610+0000 7fdab7200640 1 Processor -- start 2024-03-19T06:38:49.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.610+0000 7fdab7200640 1 -- start start 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdab00c8810 0x7fdab00ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151cb0 0x7fdab00c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00c61d0 con 0x7fdab015b6a0 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0072190 con 0x7fdab0151cb0 2024-03-19T06:38:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab7200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab006df60 con 0x7fdab00c8810 2024-03-19T06:38:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.611+0000 7fdab6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.612+0000 7fdab6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60456/0 (socket says 172.21.15.17:60456) 2024-03-19T06:38:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.612+0000 7fdab6800640 1 -- 172.21.15.17:0/387933255 learned_addr learned my addr 172.21.15.17:0/387933255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.613+0000 7fdab5400640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151cb0 0x7fdab00c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.613+0000 7fdab5e00640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdab00c8810 0x7fdab00ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.616+0000 7fdab6800640 1 -- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdab00c8810 msgr2=0x7fdab00ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.616+0000 7fdab6800640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdab00c8810 0x7fdab00ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.616+0000 7fdab6800640 1 -- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151cb0 msgr2=0x7fdab00c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.616+0000 7fdab6800640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151cb0 0x7fdab00c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:49.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.616+0000 7fdab6800640 1 -- 172.21.15.17:0/387933255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0152190 con 0x7fdab015b6a0 2024-03-19T06:38:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.619+0000 7fdab6800640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009d90 tx=0x7fdaac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.625+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac039050 con 0x7fdab015b6a0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.625+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac045070 con 0x7fdab015b6a0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.625+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac03e830 con 0x7fdab015b6a0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.625+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab0152430 con 0x7fdab015b6a0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.626+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab00c93d0 con 0x7fdab015b6a0 2024-03-19T06:38:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.627+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab00ca680 con 0x7fdab015b6a0 2024-03-19T06:38:49.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.651+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fdaac03e9d0 con 0x7fdab015b6a0 2024-03-19T06:38:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.652+0000 7fdaaa000640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 0x7fda9006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:49.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.653+0000 7fdab5e00640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 0x7fda9006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:49.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:49.654+0000 7fdab5e00640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 0x7fda9006e0e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4001640 tx=0x7fdaa4009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.031+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdaac07a880 con 0x7fdab015b6a0 2024-03-19T06:38:50.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.032+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fdaac07cee0 con 0x7fdab015b6a0 2024-03-19T06:38:50.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.247+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdab00686e0 con 0x7fda9006bc20 2024-03-19T06:38:50.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.248+0000 7fdaaa000640 1 -- 172.21.15.17:0/387933255 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdab00686e0 con 0x7fda9006bc20 2024-03-19T06:38:50.233 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.251+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 msgr2=0x7fda9006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.251+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 0x7fda9006e0e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4001640 tx=0x7fdaa4009040 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.251+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 msgr2=0x7fdab00c2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.251+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009d90 tx=0x7fdaac004a40 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 shutdown_connections 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdab015b6a0 0x7fdab00c2af0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fda9006bc20 0x7fda9006e0e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151cb0 0x7fdab00c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 --2- 172.21.15.17:0/387933255 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdab00c8810 0x7fdab00ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 >> 172.21.15.17:0/387933255 conn(0x7fdab006e630 msgr2=0x7fdab014ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 shutdown_connections 2024-03-19T06:38:50.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.252+0000 7fdab7200640 1 -- 172.21.15.17:0/387933255 wait complete. 2024-03-19T06:38:50.254 INFO:tasks.ceph:Scrubbing osd.2 2024-03-19T06:38:50.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.476+0000 7f8dc8a00640 1 Processor -- start 2024-03-19T06:38:50.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.476+0000 7f8dc8a00640 1 -- start start 2024-03-19T06:38:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.478+0000 7f8dc8a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8dc4151d80 0x7f8dc40c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.478+0000 7f8dc8a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc4157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.478+0000 7f8dc8a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc40ccdd0 con 0x7f8dc40c32b0 2024-03-19T06:38:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.478+0000 7f8dc8a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc40cd210 con 0x7f8dc4151d80 2024-03-19T06:38:50.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.478+0000 7f8dc8a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40cc5c0 con 0x7f8dc40c7210 2024-03-19T06:38:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.480+0000 7f8dc1e00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8dc4151d80 0x7f8dc40c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.481+0000 7f8dc2800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc4157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.481+0000 7f8dbbe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8dc40c32b0 0x7f8dc40c59e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49244/0 (socket says 172.21.15.17:49244) 2024-03-19T06:38:50.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.481+0000 7f8dbbe00640 1 -- 172.21.15.17:0/2248081083 learned_addr learned my addr 172.21.15.17:0/2248081083 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:50.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.484+0000 7f8dc1400640 1 -- 172.21.15.17:0/2248081083 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619630799 0 0) 0x7f8dc40ccdd0 con 0x7f8dc40c32b0 2024-03-19T06:38:50.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.484+0000 7f8dc1400640 1 -- 172.21.15.17:0/2248081083 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8da8003520 con 0x7f8dc40c32b0 2024-03-19T06:38:50.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.488+0000 7f8dc1e00640 1 -- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 msgr2=0x7f8dc4157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.488+0000 7f8dc1e00640 1 --2- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc4157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.488+0000 7f8dc1e00640 1 -- 172.21.15.17:0/2248081083 >> v1:172.21.15.17:6789/0 conn(0x7f8dc40c32b0 legacy=0x7f8dc40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.488+0000 7f8dc1e00640 1 -- 172.21.15.17:0/2248081083 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40728d0 con 0x7f8dc4151d80 2024-03-19T06:38:50.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.493+0000 7f8dc1e00640 1 --2- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc40c6cd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097d0 tx=0x7f8db402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9f038b98c9c6a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.505+0000 7f8dc1400640 1 -- 172.21.15.17:0/2248081083 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4035020 con 0x7f8dc4151d80 2024-03-19T06:38:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.505+0000 7f8dc1400640 1 -- 172.21.15.17:0/2248081083 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4031800 con 0x7f8dc4151d80 2024-03-19T06:38:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.505+0000 7f8dc1400640 1 -- 172.21.15.17:0/2248081083 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4031bd0 con 0x7f8dc4151d80 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 -- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 msgr2=0x7f8dc40c6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc40c6cd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8db40097d0 tx=0x7f8db402b8a0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 -- 172.21.15.17:0/2248081083 shutdown_connections 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc4157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/2248081083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc40c6cd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 -- 172.21.15.17:0/2248081083 >> 172.21.15.17:0/2248081083 conn(0x7f8dc406e2e0 msgr2=0x7f8dc406bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 -- 172.21.15.17:0/2248081083 shutdown_connections 2024-03-19T06:38:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.506+0000 7f8dc8a00640 1 -- 172.21.15.17:0/2248081083 wait complete. 2024-03-19T06:38:50.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.509+0000 7f8dc8a00640 1 Processor -- start 2024-03-19T06:38:50.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.509+0000 7f8dc8a00640 1 -- start start 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc40cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc41ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 0x7f8dc4147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc4072b70 con 0x7f8dc40c5330 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc40ccaf0 con 0x7f8dc4151d80 2024-03-19T06:38:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.511+0000 7f8dc8a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc4072e50 con 0x7f8dc40c7210 2024-03-19T06:38:50.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.512+0000 7f8dc2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 0x7f8dc4147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.513+0000 7f8dc2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 0x7f8dc4147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33408/0 (socket says 172.21.15.17:33408) 2024-03-19T06:38:50.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.513+0000 7f8dc2800640 1 -- 172.21.15.17:0/4189931900 learned_addr learned my addr 172.21.15.17:0/4189931900 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:50.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.513+0000 7f8dbbe00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc41ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.513+0000 7f8dc1e00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc40cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.517+0000 7f8dc2800640 1 -- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 msgr2=0x7f8dc40cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.517+0000 7f8dc2800640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f8dc40c7210 0x7f8dc40cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.517+0000 7f8dc2800640 1 -- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 msgr2=0x7f8dc41ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.517+0000 7f8dc2800640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dc4151d80 0x7f8dc41ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.517+0000 7f8dc2800640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc4156070 con 0x7f8dc40c5330 2024-03-19T06:38:50.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.520+0000 7f8dc2800640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 0x7f8dc4147b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00efc0 tx=0x7f8dbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.528+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc018020 con 0x7f8dc40c5330 2024-03-19T06:38:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.528+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dbc014480 con 0x7f8dc40c5330 2024-03-19T06:38:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.528+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc014870 con 0x7f8dc40c5330 2024-03-19T06:38:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.528+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc40cc190 con 0x7f8dc40c5330 2024-03-19T06:38:50.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.528+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc4156310 con 0x7f8dc40c5330 2024-03-19T06:38:50.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.529+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8dc4067d60 con 0x7f8dc40c5330 2024-03-19T06:38:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.575+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f8dbc005d10 con 0x7f8dc40c5330 2024-03-19T06:38:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.577+0000 7f8dba000640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8da006bc20 0x7f8da006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.578+0000 7f8dc1e00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8da006bc20 0x7f8da006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.580+0000 7f8dc1e00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8da006bc20 0x7f8da006e0e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8db4036000 tx=0x7f8db403c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.587+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8dbc058100 con 0x7f8dc40c5330 2024-03-19T06:38:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.588+0000 7f8dba000640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f8da0075640 0x7f8da0077ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.588+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8dbc012e50 con 0x7f8da0075640 2024-03-19T06:38:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.588+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dbc056300 con 0x7f8dc40c5330 2024-03-19T06:38:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.589+0000 7f8dbbe00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f8da0075640 0x7f8da0077ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.590+0000 7f8dbbe00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f8da0075640 0x7f8da0077ae0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.592+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== osd.2 v2:172.21.15.17:6800/4048444499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8dbc012e50 con 0x7f8da0075640 2024-03-19T06:38:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.612+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 --> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8dc414d120 con 0x7f8da0075640 2024-03-19T06:38:50.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.613+0000 7f8dba000640 1 -- 172.21.15.17:0/4189931900 <== osd.2 v2:172.21.15.17:6800/4048444499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8dc414d120 con 0x7f8da0075640 2024-03-19T06:38:50.598 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:50.598 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:50.598 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.613+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f8da0075640 msgr2=0x7f8da0077ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.613+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6800/4048444499,v1:172.21.15.17:6801/4048444499] conn(0x7f8da0075640 0x7f8da0077ae0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8da006bc20 msgr2=0x7f8da006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f8da006bc20 0x7f8da006e0e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8db4036000 tx=0x7f8db403c040 comp rx=0 tx=0).stop 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 msgr2=0x7f8dc4147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 --2- 172.21.15.17:0/4189931900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dc40c5330 0x7f8dc4147b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00efc0 tx=0x7f8dbc00c490 comp rx=0 tx=0).stop 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc2800640 1 -- 172.21.15.17:0/4189931900 reap_dead start 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 shutdown_connections 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 >> 172.21.15.17:0/4189931900 conn(0x7f8dc406e2e0 msgr2=0x7f8dc414d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 shutdown_connections 2024-03-19T06:38:50.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.614+0000 7f8dc8a00640 1 -- 172.21.15.17:0/4189931900 wait complete. 2024-03-19T06:38:50.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-19T06:38:50.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.861+0000 7f3aa2400640 1 Processor -- start 2024-03-19T06:38:50.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.861+0000 7f3aa2400640 1 -- start start 2024-03-19T06:38:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.862+0000 7f3aa2400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a9c153e90 0x7f3a9c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.862+0000 7f3aa2400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a9c15d410 0x7f3a9c15d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.862+0000 7f3aa2400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9c154270 con 0x7f3a9c0cb400 2024-03-19T06:38:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.862+0000 7f3aa2400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c15dd90 con 0x7f3a9c15d410 2024-03-19T06:38:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.862+0000 7f3aa2400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c159cd0 con 0x7f3a9c153e90 2024-03-19T06:38:50.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.863+0000 7f3aa1a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3a9c15d410 0x7f3a9c15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.864+0000 7f3a9be00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3a9c0cb400 0x7f3a9c0ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49258/0 (socket says 172.21.15.17:49258) 2024-03-19T06:38:50.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.864+0000 7f3a9be00640 1 -- 172.21.15.17:0/2218470438 learned_addr learned my addr 172.21.15.17:0/2218470438 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.864+0000 7f3aa1000640 1 --2- 172.21.15.17:0/2218470438 >> v2:172.21.15.153:3300/0 conn(0x7f3a9c153e90 0x7f3a9c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.867+0000 7f3aa1a00640 1 -- 172.21.15.17:0/2218470438 >> v2:172.21.15.153:3300/0 conn(0x7f3a9c153e90 msgr2=0x7f3a9c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:50.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.867+0000 7f3aa1a00640 1 --2- 172.21.15.17:0/2218470438 >> v2:172.21.15.153:3300/0 conn(0x7f3a9c153e90 0x7f3a9c0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.867+0000 7f3aa1a00640 1 -- 172.21.15.17:0/2218470438 >> v1:172.21.15.17:6789/0 conn(0x7f3a9c0cb400 legacy=0x7f3a9c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.867+0000 7f3aa1a00640 1 -- 172.21.15.17:0/2218470438 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c159fb0 con 0x7f3a9c15d410 2024-03-19T06:38:50.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.872+0000 7f3aa1a00640 1 --2- 172.21.15.17:0/2218470438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c15d410 0x7f3a9c15d850 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0c9df0 tx=0x7f3a9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f33bae27dbab8c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.879+0000 7f3a9b400640 1 -- 172.21.15.17:0/2218470438 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94035020 con 0x7f3a9c15d410 2024-03-19T06:38:50.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.879+0000 7f3a9b400640 1 -- 172.21.15.17:0/2218470438 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a94031830 con 0x7f3a9c15d410 2024-03-19T06:38:50.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.879+0000 7f3a9b400640 1 -- 172.21.15.17:0/2218470438 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94031c00 con 0x7f3a9c15d410 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 -- 172.21.15.17:0/2218470438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c15d410 msgr2=0x7f3a9c15d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 --2- 172.21.15.17:0/2218470438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c15d410 0x7f3a9c15d850 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0c9df0 tx=0x7f3a9402b8d0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 -- 172.21.15.17:0/2218470438 shutdown_connections 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 --2- 172.21.15.17:0/2218470438 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c15d410 0x7f3a9c15d850 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 --2- 172.21.15.17:0/2218470438 >> v2:172.21.15.153:3300/0 conn(0x7f3a9c153e90 0x7f3a9c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 -- 172.21.15.17:0/2218470438 >> 172.21.15.17:0/2218470438 conn(0x7f3a9c06b540 msgr2=0x7f3a9c06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 -- 172.21.15.17:0/2218470438 shutdown_connections 2024-03-19T06:38:50.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.880+0000 7f3aa2400640 1 -- 172.21.15.17:0/2218470438 wait complete. 2024-03-19T06:38:50.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.882+0000 7f3aa2400640 1 Processor -- start 2024-03-19T06:38:50.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.882+0000 7f3aa2400640 1 -- start start 2024-03-19T06:38:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.883+0000 7f3aa2400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.884+0000 7f3aa2400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a9c153e90 0x7f3a9c1f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.884+0000 7f3aa2400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9c15d410 0x7f3a9c1f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.884+0000 7f3aa2400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c15a850 con 0x7f3a9c0cb400 2024-03-19T06:38:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.884+0000 7f3aa2400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c15a570 con 0x7f3a9c15d410 2024-03-19T06:38:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.884+0000 7f3aa2400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c0c6750 con 0x7f3a9c153e90 2024-03-19T06:38:50.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.885+0000 7f3aa1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.885+0000 7f3aa1000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33426/0 (socket says 172.21.15.17:33426) 2024-03-19T06:38:50.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.885+0000 7f3aa1000640 1 -- 172.21.15.17:0/1612903363 learned_addr learned my addr 172.21.15.17:0/1612903363 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:50.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.885+0000 7f3aa1a00640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9c15d410 0x7f3a9c1f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.886+0000 7f3a9be00640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a9c153e90 0x7f3a9c1f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.891+0000 7f3aa1000640 1 -- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a9c153e90 msgr2=0x7f3a9c1f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.891+0000 7f3aa1000640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a9c153e90 0x7f3a9c1f0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.891+0000 7f3aa1000640 1 -- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9c15d410 msgr2=0x7f3a9c1f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.891+0000 7f3aa1000640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9c15d410 0x7f3a9c1f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:50.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.891+0000 7f3aa1000640 1 -- 172.21.15.17:0/1612903363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c15b6f0 con 0x7f3a9c0cb400 2024-03-19T06:38:50.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.894+0000 7f3aa1000640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00efc0 tx=0x7f3a8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.899+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c018020 con 0x7f3a9c0cb400 2024-03-19T06:38:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.899+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c014480 con 0x7f3a9c0cb400 2024-03-19T06:38:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.899+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c014870 con 0x7f3a9c0cb400 2024-03-19T06:38:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.899+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c15b960 con 0x7f3a9c0cb400 2024-03-19T06:38:50.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.899+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c15bf20 con 0x7f3a9c0cb400 2024-03-19T06:38:50.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.901+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c04f050 con 0x7f3a9c0cb400 2024-03-19T06:38:50.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.932+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3a8c005d10 con 0x7f3a9c0cb400 2024-03-19T06:38:50.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.934+0000 7f3a98c00640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 0x7f3a7c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:50.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.934+0000 7f3a9be00640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 0x7f3a7c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.935+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3a8c058280 con 0x7f3a9c0cb400 2024-03-19T06:38:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:50.936+0000 7f3a9be00640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 0x7f3a7c06e0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0cf140 tx=0x7f3a88007e80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.261+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f3a8c022030 con 0x7f3a9c0cb400 2024-03-19T06:38:51.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.530+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a9c15c270 con 0x7f3a7c06bc20 2024-03-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.531+0000 7f3a98c00640 1 -- 172.21.15.17:0/1612903363 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3a9c15c270 con 0x7f3a7c06bc20 2024-03-19T06:38:51.516 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 msgr2=0x7f3a7c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 0x7f3a7c06e0e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0cf140 tx=0x7f3a88007e80 comp rx=0 tx=0).stop 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 msgr2=0x7f3a9c15cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00efc0 tx=0x7f3a8c00c490 comp rx=0 tx=0).stop 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 shutdown_connections 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3a7c06bc20 0x7f3a7c06e0e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9c15d410 0x7f3a9c1f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3a9c153e90 0x7f3a9c1f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 --2- 172.21.15.17:0/1612903363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a9c0cb400 0x7f3a9c15cba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 >> 172.21.15.17:0/1612903363 conn(0x7f3a9c06b540 msgr2=0x7f3a9c14f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:51.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 shutdown_connections 2024-03-19T06:38:51.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.534+0000 7f3aa2400640 1 -- 172.21.15.17:0/1612903363 wait complete. 2024-03-19T06:38:51.538 INFO:tasks.ceph:Scrubbing osd.3 2024-03-19T06:38:51.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:51.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.773+0000 7f7cacc00640 1 Processor -- start 2024-03-19T06:38:51.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.773+0000 7f7cacc00640 1 -- start start 2024-03-19T06:38:51.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.775+0000 7f7cacc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7ca8154370 0x7f7ca815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.775+0000 7f7cacc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c6580 con 0x7f7ca806d090 2024-03-19T06:38:51.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.775+0000 7f7cacc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca80c6860 con 0x7f7ca806ccb0 2024-03-19T06:38:51.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.775+0000 7f7cacc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca80c6b40 con 0x7f7ca8154370 2024-03-19T06:38:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.776+0000 7f7c9d400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7ca806d090 0x7f7ca8153c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49264/0 (socket says 172.21.15.17:49264) 2024-03-19T06:38:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.776+0000 7f7c9d400640 1 -- 172.21.15.17:0/952104354 learned_addr learned my addr 172.21.15.17:0/952104354 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.776+0000 7f7ca6800640 1 --2- 172.21.15.17:0/952104354 >> v2:172.21.15.17:3300/0 conn(0x7f7ca8154370 0x7f7ca815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.783+0000 7f7ca5400640 1 -- 172.21.15.17:0/952104354 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132318927 0 0) 0x7f7ca80c6860 con 0x7f7ca806ccb0 2024-03-19T06:38:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.784+0000 7f7ca5400640 1 -- 172.21.15.17:0/952104354 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c003520 con 0x7f7ca806ccb0 2024-03-19T06:38:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.784+0000 7f7ca6800640 1 -- 172.21.15.17:0/952104354 >> v1:172.21.15.153:6789/0 conn(0x7f7ca806ccb0 legacy=0x7f7ca815de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.784+0000 7f7ca6800640 1 -- 172.21.15.17:0/952104354 >> v1:172.21.15.17:6789/0 conn(0x7f7ca806d090 legacy=0x7f7ca8153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.784+0000 7f7ca6800640 1 -- 172.21.15.17:0/952104354 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca815a000 con 0x7f7ca8154370 2024-03-19T06:38:51.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.790+0000 7f7ca6800640 1 --2- 172.21.15.17:0/952104354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8154370 0x7f7ca815aae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009d90 tx=0x7f7ca002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7260f873af2ca974 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:51.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.796+0000 7f7ca5400640 1 -- 172.21.15.17:0/952104354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0039070 con 0x7f7ca8154370 2024-03-19T06:38:51.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.796+0000 7f7ca5400640 1 -- 172.21.15.17:0/952104354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca002ccf0 con 0x7f7ca8154370 2024-03-19T06:38:51.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.796+0000 7f7ca5400640 1 -- 172.21.15.17:0/952104354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0034660 con 0x7f7ca8154370 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 -- 172.21.15.17:0/952104354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8154370 msgr2=0x7f7ca815aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 --2- 172.21.15.17:0/952104354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8154370 0x7f7ca815aae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009d90 tx=0x7f7ca002bf40 comp rx=0 tx=0).stop 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 -- 172.21.15.17:0/952104354 shutdown_connections 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 --2- 172.21.15.17:0/952104354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca8154370 0x7f7ca815aae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 -- 172.21.15.17:0/952104354 >> 172.21.15.17:0/952104354 conn(0x7f7ca806b020 msgr2=0x7f7ca806b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 -- 172.21.15.17:0/952104354 shutdown_connections 2024-03-19T06:38:51.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.797+0000 7f7cacc00640 1 -- 172.21.15.17:0/952104354 wait complete. 2024-03-19T06:38:51.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.799+0000 7f7cacc00640 1 Processor -- start 2024-03-19T06:38:51.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.799+0000 7f7cacc00640 1 -- start start 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ca806ccb0 0x7f7ca80c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 0x7f7ca8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ca8154370 0x7f7ca81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80c79a0 con 0x7f7ca806d090 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815a5c0 con 0x7f7ca8154370 2024-03-19T06:38:51.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.800+0000 7f7cacc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca8070c10 con 0x7f7ca806ccb0 2024-03-19T06:38:51.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.801+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 0x7f7ca8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.801+0000 7f7c9d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 0x7f7ca8158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33450/0 (socket says 172.21.15.17:33450) 2024-03-19T06:38:51.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.801+0000 7f7c9d400640 1 -- 172.21.15.17:0/3556776952 learned_addr learned my addr 172.21.15.17:0/3556776952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:51.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.802+0000 7f7ca6800640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ca8154370 0x7f7ca81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.802+0000 7f7ca5e00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ca806ccb0 0x7f7ca80c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.805+0000 7f7c9d400640 1 -- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ca806ccb0 msgr2=0x7f7ca80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.805+0000 7f7c9d400640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f7ca806ccb0 0x7f7ca80c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.805+0000 7f7c9d400640 1 -- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ca8154370 msgr2=0x7f7ca81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.805+0000 7f7c9d400640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ca8154370 0x7f7ca81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.806+0000 7f7c9d400640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca81e3880 con 0x7f7ca806d090 2024-03-19T06:38:51.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.808+0000 7f7c9d400640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 0x7f7ca8158480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c500 tx=0x7f7c9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.813+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90017070 con 0x7f7ca806d090 2024-03-19T06:38:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.813+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90005ce0 con 0x7f7ca806d090 2024-03-19T06:38:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.813+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900072f0 con 0x7f7ca806d090 2024-03-19T06:38:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.813+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80c93a0 con 0x7f7ca806d090 2024-03-19T06:38:51.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.813+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca81e3dd0 con 0x7f7ca806d090 2024-03-19T06:38:51.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.814+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ca81517f0 con 0x7f7ca806d090 2024-03-19T06:38:51.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.839+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f7c9001a070 con 0x7f7ca806d090 2024-03-19T06:38:51.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.840+0000 7f7c9ea00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7c8406bc20 0x7f7c8406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.840+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7c90077bb0 con 0x7f7ca806d090 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.841+0000 7f7ca5e00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7c8406bc20 0x7f7c8406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.841+0000 7f7c9ea00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7f7c84075640 0x7f7c84077ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.841+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c9000ee50 con 0x7f7c84075640 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.841+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c90054ff0 con 0x7f7ca806d090 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.841+0000 7f7ca6800640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7f7c84075640 0x7f7c84077ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:51.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.842+0000 7f7ca5e00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7c8406bc20 0x7f7c8406e0e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007fd0 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:51.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.842+0000 7f7ca6800640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7f7c84075640 0x7f7c84077ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:51.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.843+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== osd.3 v2:172.21.15.17:6808/439475340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7c9000ee50 con 0x7f7c84075640 2024-03-19T06:38:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.861+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 --> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ca8069be0 con 0x7f7c84075640 2024-03-19T06:38:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.862+0000 7f7c9ea00640 1 -- 172.21.15.17:0/3556776952 <== osd.3 v2:172.21.15.17:6808/439475340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7ca8069be0 con 0x7f7c84075640 2024-03-19T06:38:51.847 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:51.847 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:51.847 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7f7c84075640 msgr2=0x7f7c84077ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6808/439475340,v1:172.21.15.17:6809/439475340] conn(0x7f7c84075640 0x7f7c84077ae0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7c8406bc20 msgr2=0x7f7c8406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f7c8406bc20 0x7f7c8406e0e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7c98007fd0 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 msgr2=0x7f7ca8158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 --2- 172.21.15.17:0/3556776952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ca806d090 0x7f7ca8158480 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c500 tx=0x7f7c9000c9c0 comp rx=0 tx=0).stop 2024-03-19T06:38:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7ca6800640 1 -- 172.21.15.17:0/3556776952 reap_dead start 2024-03-19T06:38:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 shutdown_connections 2024-03-19T06:38:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 >> 172.21.15.17:0/3556776952 conn(0x7f7ca806b020 msgr2=0x7f7ca8146cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 shutdown_connections 2024-03-19T06:38:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:51.863+0000 7f7cacc00640 1 -- 172.21.15.17:0/3556776952 wait complete. 2024-03-19T06:38:51.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-19T06:38:52.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.099+0000 7fc63cc00640 1 Processor -- start 2024-03-19T06:38:52.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.100+0000 7fc63cc00640 1 -- start start 2024-03-19T06:38:52.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.101+0000 7fc63cc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6380c1e60 0x7fc6380c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:52.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.101+0000 7fc63cc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380c27c0 con 0x7fc638151f70 2024-03-19T06:38:52.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.101+0000 7fc63cc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc638157be0 con 0x7fc63815b1d0 2024-03-19T06:38:52.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.101+0000 7fc63cc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc638157f30 con 0x7fc6380c1e60 2024-03-19T06:38:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.102+0000 7fc635e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc638151f70 0x7fc6381583c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49268/0 (socket says 172.21.15.17:49268) 2024-03-19T06:38:52.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.102+0000 7fc635e00640 1 -- 172.21.15.17:0/730152571 learned_addr learned my addr 172.21.15.17:0/730152571 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.106+0000 7fc636800640 1 --2- 172.21.15.17:0/730152571 >> v2:172.21.15.17:3300/0 conn(0x7fc6380c1e60 0x7fc6380c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:52.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.106+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21428493 0 0) 0x7fc6380c27c0 con 0x7fc638151f70 2024-03-19T06:38:52.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.106+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc61c003520 con 0x7fc638151f70 2024-03-19T06:38:52.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.110+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021020548 0 0) 0x7fc638157be0 con 0x7fc63815b1d0 2024-03-19T06:38:52.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.111+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6380c27c0 con 0x7fc63815b1d0 2024-03-19T06:38:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.113+0000 7fc636800640 1 -- 172.21.15.17:0/730152571 >> v1:172.21.15.153:6789/0 conn(0x7fc63815b1d0 legacy=0x7fc63806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.113+0000 7fc636800640 1 -- 172.21.15.17:0/730152571 >> v1:172.21.15.17:6789/0 conn(0x7fc638151f70 legacy=0x7fc6381583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.113+0000 7fc636800640 1 -- 172.21.15.17:0/730152571 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63815b730 con 0x7fc6380c1e60 2024-03-19T06:38:52.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.119+0000 7fc636800640 1 --2- 172.21.15.17:0/730152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6380c1e60 0x7fc6380c7760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc6381580b0 tx=0x7fc63002bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5972dca0221b4a3f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:52.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.126+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630039070 con 0x7fc6380c1e60 2024-03-19T06:38:52.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.126+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63002cd70 con 0x7fc6380c1e60 2024-03-19T06:38:52.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.126+0000 7fc635400640 1 -- 172.21.15.17:0/730152571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630034660 con 0x7fc6380c1e60 2024-03-19T06:38:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.127+0000 7fc63cc00640 1 -- 172.21.15.17:0/730152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6380c1e60 msgr2=0x7fc6380c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.127+0000 7fc63cc00640 1 --2- 172.21.15.17:0/730152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6380c1e60 0x7fc6380c7760 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc6381580b0 tx=0x7fc63002bfc0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.128+0000 7fc63cc00640 1 -- 172.21.15.17:0/730152571 shutdown_connections 2024-03-19T06:38:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.128+0000 7fc63cc00640 1 --2- 172.21.15.17:0/730152571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6380c1e60 0x7fc6380c7760 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.128+0000 7fc63cc00640 1 -- 172.21.15.17:0/730152571 >> 172.21.15.17:0/730152571 conn(0x7fc6380c8910 msgr2=0x7fc6380cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.128+0000 7fc63cc00640 1 -- 172.21.15.17:0/730152571 shutdown_connections 2024-03-19T06:38:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.128+0000 7fc63cc00640 1 -- 172.21.15.17:0/730152571 wait complete. 2024-03-19T06:38:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.131+0000 7fc63cc00640 1 Processor -- start 2024-03-19T06:38:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.131+0000 7fc63cc00640 1 -- start start 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6380c1e60 0x7fc6380c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc638151f70 0x7fc638157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815bcf0 con 0x7fc63815b1d0 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638152350 con 0x7fc638151f70 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.133+0000 7fc63cc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815bfd0 con 0x7fc6380c1e60 2024-03-19T06:38:52.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.134+0000 7fc636800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.134+0000 7fc62d400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc638151f70 0x7fc638157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.135+0000 7fc636800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33462/0 (socket says 172.21.15.17:33462) 2024-03-19T06:38:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.135+0000 7fc636800640 1 -- 172.21.15.17:0/227490795 learned_addr learned my addr 172.21.15.17:0/227490795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.135+0000 7fc635e00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6380c1e60 0x7fc6380c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:52.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.141+0000 7fc636800640 1 -- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6380c1e60 msgr2=0x7fc6380c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.141+0000 7fc636800640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6380c1e60 0x7fc6380c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.141+0000 7fc636800640 1 -- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc638151f70 msgr2=0x7fc638157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.141+0000 7fc636800640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc638151f70 0x7fc638157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.141+0000 7fc636800640 1 -- 172.21.15.17:0/227490795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6381f8230 con 0x7fc63815b1d0 2024-03-19T06:38:52.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.145+0000 7fc636800640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e80 tx=0x7fc630004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.149+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630039050 con 0x7fc63815b1d0 2024-03-19T06:38:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.149+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6381f76b0 con 0x7fc63815b1d0 2024-03-19T06:38:52.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.149+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6381f7c70 con 0x7fc63815b1d0 2024-03-19T06:38:52.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.151+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638069be0 con 0x7fc63815b1d0 2024-03-19T06:38:52.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.152+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630045070 con 0x7fc63815b1d0 2024-03-19T06:38:52.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.152+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630009450 con 0x7fc63815b1d0 2024-03-19T06:38:52.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.478+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc63003e810 con 0x7fc63815b1d0 2024-03-19T06:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.480+0000 7fc62ea00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 0x7fc61406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:52.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.481+0000 7fc635e00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 0x7fc61406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:52.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.482+0000 7fc635e00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 0x7fc61406e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc628000f60 tx=0x7fc628009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:52.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.554+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc63007a6b0 con 0x7fc63815b1d0 2024-03-19T06:38:52.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.555+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc63007c610 con 0x7fc63815b1d0 2024-03-19T06:38:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.790+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6380c6a00 con 0x7fc61406bbd0 2024-03-19T06:38:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-03-19T06:38:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.791+0000 7fc62ea00640 1 -- 172.21.15.17:0/227490795 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc6380c6a00 con 0x7fc61406bbd0 2024-03-19T06:38:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 msgr2=0x7fc61406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 0x7fc61406e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc628000f60 tx=0x7fc628009040 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 msgr2=0x7fc6381f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc630009e80 tx=0x7fc630004a40 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 shutdown_connections 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc63815b1d0 0x7fc6381f4430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc61406bbd0 0x7fc61406e090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc638151f70 0x7fc638157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 --2- 172.21.15.17:0/227490795 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc6380c1e60 0x7fc6380c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 >> 172.21.15.17:0/227490795 conn(0x7fc6380c8910 msgr2=0x7fc638150fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 shutdown_connections 2024-03-19T06:38:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:52.794+0000 7fc63cc00640 1 -- 172.21.15.17:0/227490795 wait complete. 2024-03-19T06:38:52.799 INFO:tasks.ceph:Scrubbing osd.4 2024-03-19T06:38:52.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.030+0000 7f56e6000640 1 Processor -- start 2024-03-19T06:38:53.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.031+0000 7f56e6000640 1 -- start start 2024-03-19T06:38:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.032+0000 7f56e6000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f56e006ccb0 0x7f56e00c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.032+0000 7f56e6000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f56e0151890 0x7f56e0151d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.032+0000 7f56e6000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e0157cf0 con 0x7f56e006d090 2024-03-19T06:38:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.032+0000 7f56e6000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e0157f90 con 0x7f56e0151890 2024-03-19T06:38:53.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.032+0000 7f56e6000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e0158270 con 0x7f56e006ccb0 2024-03-19T06:38:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.034+0000 7f56dea00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f56e006d090 0x7f56e00c7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49272/0 (socket says 172.21.15.17:49272) 2024-03-19T06:38:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.034+0000 7f56dea00640 1 -- 172.21.15.17:0/340775262 learned_addr learned my addr 172.21.15.17:0/340775262 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.034+0000 7f56dfe00640 1 --2- 172.21.15.17:0/340775262 >> v2:172.21.15.17:3300/0 conn(0x7f56e0151890 0x7f56e0151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.034+0000 7f56df400640 1 --2- 172.21.15.17:0/340775262 >> v2:172.21.15.153:3300/0 conn(0x7f56e006ccb0 0x7f56e00c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.040+0000 7f56dfe00640 1 -- 172.21.15.17:0/340775262 >> v2:172.21.15.153:3300/0 conn(0x7f56e006ccb0 msgr2=0x7f56e00c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:53.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.040+0000 7f56dfe00640 1 --2- 172.21.15.17:0/340775262 >> v2:172.21.15.153:3300/0 conn(0x7f56e006ccb0 0x7f56e00c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.040+0000 7f56dfe00640 1 -- 172.21.15.17:0/340775262 >> v1:172.21.15.17:6789/0 conn(0x7f56e006d090 legacy=0x7f56e00c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.040+0000 7f56dfe00640 1 -- 172.21.15.17:0/340775262 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0158550 con 0x7f56e0151890 2024-03-19T06:38:53.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.044+0000 7f56dfe00640 1 --2- 172.21.15.17:0/340775262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e0151d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0c0f1dfd3b2341 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.050+0000 7f56de000640 1 -- 172.21.15.17:0/340775262 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8034070 con 0x7f56e0151890 2024-03-19T06:38:53.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.050+0000 7f56de000640 1 -- 172.21.15.17:0/340775262 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d8030610 con 0x7f56e0151890 2024-03-19T06:38:53.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.050+0000 7f56de000640 1 -- 172.21.15.17:0/340775262 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80309e0 con 0x7f56e0151890 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 -- 172.21.15.17:0/340775262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 msgr2=0x7f56e0151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 --2- 172.21.15.17:0/340775262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e0151d40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d802b960 comp rx=0 tx=0).stop 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 -- 172.21.15.17:0/340775262 shutdown_connections 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 --2- 172.21.15.17:0/340775262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e0151d40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 --2- 172.21.15.17:0/340775262 >> v2:172.21.15.153:3300/0 conn(0x7f56e006ccb0 0x7f56e00c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 -- 172.21.15.17:0/340775262 >> 172.21.15.17:0/340775262 conn(0x7f56e006b020 msgr2=0x7f56e006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:53.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 -- 172.21.15.17:0/340775262 shutdown_connections 2024-03-19T06:38:53.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.051+0000 7f56e6000640 1 -- 172.21.15.17:0/340775262 wait complete. 2024-03-19T06:38:53.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.053+0000 7f56e6000640 1 Processor -- start 2024-03-19T06:38:53.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.053+0000 7f56e6000640 1 -- start start 2024-03-19T06:38:53.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e006ccb0 0x7f56e0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e006d090 0x7f56e0154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e01ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e006e400 con 0x7f56e0151890 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c7b80 con 0x7f56e006ccb0 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.054+0000 7f56e6000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e006e580 con 0x7f56e006d090 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.055+0000 7f56dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e01ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.056+0000 7f56dfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e01ebfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33478/0 (socket says 172.21.15.17:33478) 2024-03-19T06:38:53.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.056+0000 7f56dfe00640 1 -- 172.21.15.17:0/4045862516 learned_addr learned my addr 172.21.15.17:0/4045862516 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.056+0000 7f56df400640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e006ccb0 0x7f56e0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.057+0000 7f56dea00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e006d090 0x7f56e0154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.060+0000 7f56dfe00640 1 -- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e006d090 msgr2=0x7f56e0154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.060+0000 7f56dfe00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f56e006d090 0x7f56e0154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.060+0000 7f56dfe00640 1 -- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e006ccb0 msgr2=0x7f56e0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.060+0000 7f56dfe00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56e006ccb0 0x7f56e0154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.060+0000 7f56dfe00640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e01ef500 con 0x7f56e0151890 2024-03-19T06:38:53.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.063+0000 7f56dfe00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e01ebfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.067+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8034040 con 0x7f56e0151890 2024-03-19T06:38:53.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.067+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d803aa20 con 0x7f56e0151890 2024-03-19T06:38:53.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.067+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d803adf0 con 0x7f56e0151890 2024-03-19T06:38:53.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.067+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e01ef7e0 con 0x7f56e0151890 2024-03-19T06:38:53.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.067+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e01efda0 con 0x7f56e0151890 2024-03-19T06:38:53.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.068+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56e0069be0 con 0x7f56e0151890 2024-03-19T06:38:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.102+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f56d804b060 con 0x7f56e0151890 2024-03-19T06:38:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.103+0000 7f56d7400640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f56bc06bc50 0x7f56bc06e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.103+0000 7f56df400640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f56bc06bc50 0x7f56bc06e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.104+0000 7f56df400640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f56bc06bc50 0x7f56bc06e110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009b40 tx=0x7f56d0009190 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.105+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f56d8079210 con 0x7f56e0151890 2024-03-19T06:38:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.105+0000 7f56d7400640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f56bc0755f0 0x7f56bc077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.105+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56d80067f0 con 0x7f56bc0755f0 2024-03-19T06:38:53.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.105+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56d8077410 con 0x7f56e0151890 2024-03-19T06:38:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.106+0000 7f56dea00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f56bc0755f0 0x7f56bc077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.107+0000 7f56dea00640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f56bc0755f0 0x7f56bc077a90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.109+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== osd.4 v2:172.21.15.153:6800/1857527364 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f56d80067f0 con 0x7f56bc0755f0 2024-03-19T06:38:53.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.128+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 --> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56e0155500 con 0x7f56bc0755f0 2024-03-19T06:38:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.130+0000 7f56d7400640 1 -- 172.21.15.17:0/4045862516 <== osd.4 v2:172.21.15.153:6800/1857527364 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f56e0155500 con 0x7f56bc0755f0 2024-03-19T06:38:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:53.115 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:53.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.130+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f56bc0755f0 msgr2=0x7f56bc077a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.130+0000 7f56e6000640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.153:6800/1857527364,v1:172.21.15.153:6801/1857527364] conn(0x7f56bc0755f0 0x7f56bc077a90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f56bc06bc50 msgr2=0x7f56bc06e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f56bc06bc50 0x7f56bc06e110 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009b40 tx=0x7f56d0009190 comp rx=0 tx=0).stop 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 msgr2=0x7f56e01ebfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 --2- 172.21.15.17:0/4045862516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56e0151890 0x7f56e01ebfa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f56d80097a0 tx=0x7f56d80046c0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56dfe00640 1 -- 172.21.15.17:0/4045862516 reap_dead start 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 shutdown_connections 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 >> 172.21.15.17:0/4045862516 conn(0x7f56e006b020 msgr2=0x7f56e00c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 shutdown_connections 2024-03-19T06:38:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.131+0000 7f56e6000640 1 -- 172.21.15.17:0/4045862516 wait complete. 2024-03-19T06:38:53.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-19T06:38:53.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.383+0000 7f1618200640 1 Processor -- start 2024-03-19T06:38:53.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.384+0000 7f1618200640 1 -- start start 2024-03-19T06:38:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.385+0000 7f1618200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16100d0060 0x7f16100c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.385+0000 7f1618200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 0x7f16100cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.385+0000 7f1618200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161015e4e0 con 0x7f16101587c0 2024-03-19T06:38:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.385+0000 7f1618200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161015f260 con 0x7f16100d0060 2024-03-19T06:38:53.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.385+0000 7f1618200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100cb4d0 con 0x7f16100cad20 2024-03-19T06:38:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.386+0000 7f1615800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f16101587c0 0x7f16100c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49280/0 (socket says 172.21.15.17:49280) 2024-03-19T06:38:53.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.386+0000 7f1615800640 1 -- 172.21.15.17:0/591506668 learned_addr learned my addr 172.21.15.17:0/591506668 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.387+0000 7f1614e00640 1 --2- 172.21.15.17:0/591506668 >> v2:172.21.15.153:3300/0 conn(0x7f16100d0060 0x7f16100c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.387+0000 7f1616200640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 0x7f16100cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.389+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832259019 0 0) 0x7f161015e4e0 con 0x7f16101587c0 2024-03-19T06:38:53.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.389+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15f8003520 con 0x7f16101587c0 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1645262016 0 0) 0x7f15f8003520 con 0x7f16101587c0 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 msgr2=0x7f16100cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 0x7f16100cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 >> v2:172.21.15.153:3300/0 conn(0x7f16100d0060 msgr2=0x7f16100c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 --2- 172.21.15.17:0/591506668 >> v2:172.21.15.153:3300/0 conn(0x7f16100d0060 0x7f16100c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100cb1f0 con 0x7f16101587c0 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f1604001670 con 0x7f16101587c0 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 >> v1:172.21.15.17:6789/0 conn(0x7f16101587c0 legacy=0x7f16100c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 0x7f15f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8003f80 0x7f15f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8004d40 0x7f15f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161015f260 con 0x7f15f8003f80 2024-03-19T06:38:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16100cb4d0 con 0x7f15f8004d40 2024-03-19T06:38:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.394+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f800ba40 con 0x7f16100cad20 2024-03-19T06:38:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.397+0000 7f1614e00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8003f80 0x7f15f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.400+0000 7f1614e00640 1 -- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 msgr2=0x7f15f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.400+0000 7f1614e00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16100cad20 0x7f15f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.400+0000 7f1614e00640 1 -- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8004d40 msgr2=0x7f15f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.400+0000 7f1614e00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15f8004d40 0x7f15f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.401+0000 7f1614e00640 1 -- 172.21.15.17:0/591506668 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f8003520 con 0x7f15f8003f80 2024-03-19T06:38:53.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.403+0000 7f1614e00640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8003f80 0x7f15f8004800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1600009f90 tx=0x7f15f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28095251d7d22c6c server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.408+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600039070 con 0x7f15f8003f80 2024-03-19T06:38:53.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.408+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160002cc20 con 0x7f15f8003f80 2024-03-19T06:38:53.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.408+0000 7f160fe00640 1 -- 172.21.15.17:0/591506668 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600009c10 con 0x7f15f8003f80 2024-03-19T06:38:53.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.409+0000 7f1618200640 1 -- 172.21.15.17:0/591506668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8003f80 msgr2=0x7f15f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.409+0000 7f1618200640 1 --2- 172.21.15.17:0/591506668 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15f8003f80 0x7f15f8004800 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1600009f90 tx=0x7f15f8005830 comp rx=0 tx=0).stop 2024-03-19T06:38:53.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.409+0000 7f1616200640 1 -- 172.21.15.17:0/591506668 reap_dead start 2024-03-19T06:38:53.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.409+0000 7f1618200640 1 -- 172.21.15.17:0/591506668 shutdown_connections 2024-03-19T06:38:53.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.409+0000 7f1618200640 1 -- 172.21.15.17:0/591506668 >> 172.21.15.17:0/591506668 conn(0x7f161006c170 msgr2=0x7f161006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:53.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.410+0000 7f1618200640 1 -- 172.21.15.17:0/591506668 shutdown_connections 2024-03-19T06:38:53.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.410+0000 7f1618200640 1 -- 172.21.15.17:0/591506668 wait complete. 2024-03-19T06:38:53.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.411+0000 7f1618200640 1 Processor -- start 2024-03-19T06:38:53.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.412+0000 7f1618200640 1 -- start start 2024-03-19T06:38:53.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.412+0000 7f1618200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16101ead80 0x7f1610162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1618200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16101eb160 0x7f1610153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1618200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1618200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161015ed40 con 0x7f1610153dc0 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1618200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161015ea60 con 0x7f16101eb160 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1618200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16100c5510 con 0x7f16101ead80 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.413+0000 7f1616200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.414+0000 7f1616200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33492/0 (socket says 172.21.15.17:33492) 2024-03-19T06:38:53.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.414+0000 7f1616200640 1 -- 172.21.15.17:0/2026021785 learned_addr learned my addr 172.21.15.17:0/2026021785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.415+0000 7f1615800640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16101ead80 0x7f1610162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.415+0000 7f1614e00640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16101eb160 0x7f1610153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.418+0000 7f1616200640 1 -- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16101ead80 msgr2=0x7f1610162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.418+0000 7f1616200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16101ead80 0x7f1610162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.418+0000 7f1616200640 1 -- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16101eb160 msgr2=0x7f1610153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.418+0000 7f1616200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16101eb160 0x7f1610153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.418+0000 7f1616200640 1 -- 172.21.15.17:0/2026021785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610160970 con 0x7f1610153dc0 2024-03-19T06:38:53.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.421+0000 7f1616200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f160800e770 tx=0x7f160800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.424+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800c6b0 con 0x7f1610153dc0 2024-03-19T06:38:53.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.425+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160801a070 con 0x7f1610153dc0 2024-03-19T06:38:53.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.425+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160800cab0 con 0x7f1610153dc0 2024-03-19T06:38:53.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.425+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1610160070 con 0x7f1610153dc0 2024-03-19T06:38:53.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.425+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1610152da0 con 0x7f1610153dc0 2024-03-19T06:38:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.426+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1610158300 con 0x7f1610153dc0 2024-03-19T06:38:53.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.741+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f160800cc50 con 0x7f1610153dc0 2024-03-19T06:38:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.744+0000 7f160d600640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 0x7f15f406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:53.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.745+0000 7f1615800640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 0x7f15f406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:53.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.746+0000 7f1615800640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 0x7f15f406e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1604001840 tx=0x7f1604001690 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.781+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1608056d40 con 0x7f1610153dc0 2024-03-19T06:38:53.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.781+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f16080593a0 con 0x7f1610153dc0 2024-03-19T06:38:53.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:53.999+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f161015fe10 con 0x7f15f406bbd0 2024-03-19T06:38:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.000+0000 7f160d600640 1 -- 172.21.15.17:0/2026021785 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1604004950 con 0x7f15f406bbd0 2024-03-19T06:38:53.985 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 msgr2=0x7f15f406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 0x7f15f406e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1604001840 tx=0x7f1604001690 comp rx=0 tx=0).stop 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 msgr2=0x7f1610151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f160800e770 tx=0x7f160800ec30 comp rx=0 tx=0).stop 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 shutdown_connections 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1610153dc0 0x7f1610151780 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f15f406bbd0 0x7f15f406e090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16101eb160 0x7f1610153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 --2- 172.21.15.17:0/2026021785 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f16101ead80 0x7f1610162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:53.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 >> 172.21.15.17:0/2026021785 conn(0x7f161006c170 msgr2=0x7f161015c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:53.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 shutdown_connections 2024-03-19T06:38:53.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.003+0000 7f1618200640 1 -- 172.21.15.17:0/2026021785 wait complete. 2024-03-19T06:38:54.008 INFO:tasks.ceph:Scrubbing osd.5 2024-03-19T06:38:54.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.234+0000 7fd05a600640 1 Processor -- start 2024-03-19T06:38:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.234+0000 7fd05a600640 1 -- start start 2024-03-19T06:38:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.236+0000 7fd05a600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0540c6d40 0x7fd0540c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.236+0000 7fd05a600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c2e90 con 0x7fd054150ba0 2024-03-19T06:38:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.236+0000 7fd05a600640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540c5d60 con 0x7fd0540c8970 2024-03-19T06:38:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.236+0000 7fd05a600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd05415a070 con 0x7fd0540c6d40 2024-03-19T06:38:54.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.237+0000 7fd059200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd054150ba0 0x7fd05415a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49282/0 (socket says 172.21.15.17:49282) 2024-03-19T06:38:54.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.237+0000 7fd059200640 1 -- 172.21.15.17:0/3250545507 learned_addr learned my addr 172.21.15.17:0/3250545507 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:54.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.239+0000 7fd053e00640 1 --2- 172.21.15.17:0/3250545507 >> v2:172.21.15.153:3300/0 conn(0x7fd0540c6d40 0x7fd0540c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.242+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734401273 0 0) 0x7fd048001110 con 0x7fd054150ba0 2024-03-19T06:38:54.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.242+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd03c003520 con 0x7fd054150ba0 2024-03-19T06:38:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 239066452 0 0) 0x7fd03c003520 con 0x7fd054150ba0 2024-03-19T06:38:54.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 >> v2:172.21.15.153:3300/0 conn(0x7fd0540c6d40 msgr2=0x7fd0540c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 --2- 172.21.15.17:0/3250545507 >> v2:172.21.15.153:3300/0 conn(0x7fd0540c6d40 0x7fd0540c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 >> v1:172.21.15.153:6789/0 conn(0x7fd0540c8970 legacy=0x7fd0541611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540c28d0 con 0x7fd054150ba0 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fd048001840 con 0x7fd054150ba0 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 >> v1:172.21.15.17:6789/0 conn(0x7fd054150ba0 legacy=0x7fd05415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd03c003a00 0x7fd03c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd03c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd03c0051c0 0x7fd03c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05415a070 con 0x7fd03c003a00 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00e2d0 con 0x7fd03c0051c0 2024-03-19T06:38:54.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.246+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c00e4d0 con 0x7fd03c004800 2024-03-19T06:38:54.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.248+0000 7fd053e00640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd03c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.250+0000 7fd059200640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd03c003a00 0x7fd03c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd053e00640 1 -- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd03c0051c0 msgr2=0x7fd03c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd053e00640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd03c0051c0 0x7fd03c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd053e00640 1 -- 172.21.15.17:0/3250545507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd03c003a00 msgr2=0x7fd03c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd053e00640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd03c003a00 0x7fd03c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd053e00640 1 -- 172.21.15.17:0/3250545507 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c003520 con 0x7fd03c004800 2024-03-19T06:38:54.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.257+0000 7fd059c00640 1 -- 172.21.15.17:0/3250545507 reap_dead start 2024-03-19T06:38:54.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.262+0000 7fd053e00640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd03c004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd040009ac0 tx=0x7fd03c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e1fb3bcee240c2f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.274+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040039070 con 0x7fd03c004800 2024-03-19T06:38:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.275+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04002c6b0 con 0x7fd03c004800 2024-03-19T06:38:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.275+0000 7fd053400640 1 -- 172.21.15.17:0/3250545507 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd040009690 con 0x7fd03c004800 2024-03-19T06:38:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 -- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 msgr2=0x7fd03c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd03c004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd040009ac0 tx=0x7fd03c005830 comp rx=0 tx=0).stop 2024-03-19T06:38:54.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 -- 172.21.15.17:0/3250545507 shutdown_connections 2024-03-19T06:38:54.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 --2- 172.21.15.17:0/3250545507 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd03c004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 -- 172.21.15.17:0/3250545507 >> 172.21.15.17:0/3250545507 conn(0x7fd05406e630 msgr2=0x7fd05406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:54.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 -- 172.21.15.17:0/3250545507 shutdown_connections 2024-03-19T06:38:54.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.276+0000 7fd05a600640 1 -- 172.21.15.17:0/3250545507 wait complete. 2024-03-19T06:38:54.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.280+0000 7fd05a600640 1 Processor -- start 2024-03-19T06:38:54.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.280+0000 7fd05a600640 1 -- start start 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd05414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05414d190 0x7fd0540cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 0x7fd054155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054072290 con 0x7fd054155af0 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd054150f80 con 0x7fd05414d190 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.282+0000 7fd05a600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd054072410 con 0x7fd03c004800 2024-03-19T06:38:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.283+0000 7fd059c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 0x7fd054155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.283+0000 7fd059c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 0x7fd054155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33506/0 (socket says 172.21.15.17:33506) 2024-03-19T06:38:54.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.283+0000 7fd059c00640 1 -- 172.21.15.17:0/1176559318 learned_addr learned my addr 172.21.15.17:0/1176559318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059200640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd05414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059c00640 1 -- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 msgr2=0x7fd05414c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059c00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fd03c004800 0x7fd05414c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059c00640 1 -- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05414d190 msgr2=0x7fd0540cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059c00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd05414d190 0x7fd0540cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.287+0000 7fd059c00640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0541564c0 con 0x7fd054155af0 2024-03-19T06:38:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.290+0000 7fd059c00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 0x7fd054155f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0540c2620 tx=0x7fd04c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.294+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c017070 con 0x7fd054155af0 2024-03-19T06:38:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.295+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c005d60 con 0x7fd054155af0 2024-03-19T06:38:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.295+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00a850 con 0x7fd054155af0 2024-03-19T06:38:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.295+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0540cb7a0 con 0x7fd054155af0 2024-03-19T06:38:54.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.295+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0541575a0 con 0x7fd054155af0 2024-03-19T06:38:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.296+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0540cbe20 con 0x7fd054155af0 2024-03-19T06:38:54.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.321+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fd04c01a070 con 0x7fd054155af0 2024-03-19T06:38:54.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.322+0000 7fd050c00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd03406bc20 0x7fd03406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.322+0000 7fd059200640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd03406bc20 0x7fd03406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.323+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd04c056570 con 0x7fd054155af0 2024-03-19T06:38:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.323+0000 7fd050c00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7fd034075630 0x7fd034077ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.323+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd04c016ec0 con 0x7fd034075630 2024-03-19T06:38:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.324+0000 7fd053e00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7fd034075630 0x7fd034077ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.324+0000 7fd059200640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd03406bc20 0x7fd03406e0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0480012b0 tx=0x7fd048001d30 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.325+0000 7fd053e00640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7fd034075630 0x7fd034077ad0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.325+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd04c054770 con 0x7fd054155af0 2024-03-19T06:38:54.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.327+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== osd.5 v2:172.21.15.153:6808/1960976366 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd04c016ec0 con 0x7fd034075630 2024-03-19T06:38:54.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.349+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 --> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd05404f050 con 0x7fd034075630 2024-03-19T06:38:54.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.350+0000 7fd050c00640 1 -- 172.21.15.17:0/1176559318 <== osd.5 v2:172.21.15.153:6808/1960976366 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd05404f050 con 0x7fd034075630 2024-03-19T06:38:54.339 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:54.339 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:54.340 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7fd034075630 msgr2=0x7fd034077ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.153:6808/1960976366,v1:172.21.15.153:6809/1960976366] conn(0x7fd034075630 0x7fd034077ad0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd03406bc20 msgr2=0x7fd03406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fd03406bc20 0x7fd03406e0e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0480012b0 tx=0x7fd048001d30 comp rx=0 tx=0).stop 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 msgr2=0x7fd054155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 --2- 172.21.15.17:0/1176559318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd054155af0 0x7fd054155f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd0540c2620 tx=0x7fd04c00cb90 comp rx=0 tx=0).stop 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd059c00640 1 -- 172.21.15.17:0/1176559318 reap_dead start 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 shutdown_connections 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.351+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 >> 172.21.15.17:0/1176559318 conn(0x7fd05406e630 msgr2=0x7fd0540c4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.352+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 shutdown_connections 2024-03-19T06:38:54.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.352+0000 7fd05a600640 1 -- 172.21.15.17:0/1176559318 wait complete. 2024-03-19T06:38:54.358 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-19T06:38:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.586+0000 7f1a7a800640 1 Processor -- start 2024-03-19T06:38:54.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.586+0000 7f1a7a800640 1 -- start start 2024-03-19T06:38:54.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.588+0000 7f1a7a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a740c8810 0x7f1a7415af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.588+0000 7f1a7a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a7415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.588+0000 7f1a7a800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740c5c50 con 0x7f1a74151cb0 2024-03-19T06:38:54.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.588+0000 7f1a7a800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740c5ef0 con 0x7f1a740c8810 2024-03-19T06:38:54.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.588+0000 7f1a7a800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740718f0 con 0x7f1a7406cee0 2024-03-19T06:38:54.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.589+0000 7f1a78a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a740c8810 0x7f1a7415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.589+0000 7f1a79400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1a74151cb0 0x7f1a7406d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49290/0 (socket says 172.21.15.17:49290) 2024-03-19T06:38:54.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.589+0000 7f1a79400640 1 -- 172.21.15.17:0/3109481644 learned_addr learned my addr 172.21.15.17:0/3109481644 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:54.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.590+0000 7f1a79e00640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a7415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.594+0000 7f1a78a00640 1 -- 172.21.15.17:0/3109481644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 msgr2=0x7f1a7415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:54.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.594+0000 7f1a78a00640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a7415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.594+0000 7f1a78a00640 1 -- 172.21.15.17:0/3109481644 >> v1:172.21.15.17:6789/0 conn(0x7f1a74151cb0 legacy=0x7f1a7406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.594+0000 7f1a78a00640 1 -- 172.21.15.17:0/3109481644 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74071bd0 con 0x7f1a740c8810 2024-03-19T06:38:54.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.599+0000 7f1a78a00640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a740c8810 0x7f1a7415af90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73d43a8515897f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.604+0000 7f1a73e00640 1 -- 172.21.15.17:0/3109481644 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a60034070 con 0x7f1a740c8810 2024-03-19T06:38:54.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.605+0000 7f1a73e00640 1 -- 172.21.15.17:0/3109481644 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a60030610 con 0x7f1a740c8810 2024-03-19T06:38:54.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.605+0000 7f1a73e00640 1 -- 172.21.15.17:0/3109481644 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a600309e0 con 0x7f1a740c8810 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.605+0000 7f1a7a800640 1 -- 172.21.15.17:0/3109481644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a740c8810 msgr2=0x7f1a7415af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.605+0000 7f1a7a800640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a740c8810 0x7f1a7415af90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a600097a0 tx=0x7f1a6002b960 comp rx=0 tx=0).stop 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 -- 172.21.15.17:0/3109481644 shutdown_connections 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a7415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 --2- 172.21.15.17:0/3109481644 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a740c8810 0x7f1a7415af90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 -- 172.21.15.17:0/3109481644 >> 172.21.15.17:0/3109481644 conn(0x7f1a7406e630 msgr2=0x7f1a7406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 -- 172.21.15.17:0/3109481644 shutdown_connections 2024-03-19T06:38:54.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.606+0000 7f1a7a800640 1 -- 172.21.15.17:0/3109481644 wait complete. 2024-03-19T06:38:54.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.609+0000 7f1a7a800640 1 Processor -- start 2024-03-19T06:38:54.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.609+0000 7f1a7a800640 1 -- start start 2024-03-19T06:38:54.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a740c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740c8810 0x7f1a741509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c61d0 con 0x7f1a74151cb0 2024-03-19T06:38:54.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74072190 con 0x7f1a740c8810 2024-03-19T06:38:54.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.610+0000 7f1a7a800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7406df60 con 0x7f1a7406cee0 2024-03-19T06:38:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.611+0000 7f1a79e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.612+0000 7f1a79e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33522/0 (socket says 172.21.15.17:33522) 2024-03-19T06:38:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.612+0000 7f1a79e00640 1 -- 172.21.15.17:0/445271376 learned_addr learned my addr 172.21.15.17:0/445271376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.612+0000 7f1a78a00640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740c8810 0x7f1a741509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.613+0000 7f1a79400640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a740c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.618+0000 7f1a79e00640 1 -- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 msgr2=0x7f1a740c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.618+0000 7f1a79e00640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a740c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.618+0000 7f1a79e00640 1 -- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740c8810 msgr2=0x7f1a741509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:54.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.618+0000 7f1a79e00640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740c8810 0x7f1a741509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:54.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.618+0000 7f1a79e00640 1 -- 172.21.15.17:0/445271376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740c27f0 con 0x7f1a74151cb0 2024-03-19T06:38:54.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.621+0000 7f1a79e00640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009dd0 tx=0x7f1a6c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.626+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c018020 con 0x7f1a74151cb0 2024-03-19T06:38:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.626+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c014480 con 0x7f1a74151cb0 2024-03-19T06:38:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.627+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c014870 con 0x7f1a74151cb0 2024-03-19T06:38:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.627+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740c2a90 con 0x7f1a74151cb0 2024-03-19T06:38:54.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.627+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a741e2450 con 0x7f1a74151cb0 2024-03-19T06:38:54.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.628+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a740686e0 con 0x7f1a74151cb0 2024-03-19T06:38:54.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.678+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f1a6c005d10 con 0x7f1a74151cb0 2024-03-19T06:38:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.680+0000 7f1a71600640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 0x7f1a5406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:54.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.681+0000 7f1a79400640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 0x7f1a5406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:54.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.682+0000 7f1a79400640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 0x7f1a5406e0e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007fd0 tx=0x7f1a68007e80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:54.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:54.684+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1a6c058540 con 0x7f1a74151cb0 2024-03-19T06:38:55.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.058+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f1a6c022070 con 0x7f1a74151cb0 2024-03-19T06:38:55.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.295+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a7404f050 con 0x7f1a5406bc20 2024-03-19T06:38:55.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.296+0000 7f1a71600640 1 -- 172.21.15.17:0/445271376 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1a7404f050 con 0x7f1a5406bc20 2024-03-19T06:38:55.281 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-03-19T06:38:55.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 msgr2=0x7f1a5406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 0x7f1a5406e0e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a68007fd0 tx=0x7f1a68007e80 comp rx=0 tx=0).stop 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 msgr2=0x7f1a741f3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009dd0 tx=0x7f1a6c00c490 comp rx=0 tx=0).stop 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 shutdown_connections 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a74151cb0 0x7f1a741f3420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f1a5406bc20 0x7f1a5406e0e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a740c8810 0x7f1a741509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 --2- 172.21.15.17:0/445271376 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f1a7406cee0 0x7f1a740c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 >> 172.21.15.17:0/445271376 conn(0x7f1a7406e630 msgr2=0x7f1a7414fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:55.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 shutdown_connections 2024-03-19T06:38:55.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.299+0000 7f1a7a800640 1 -- 172.21.15.17:0/445271376 wait complete. 2024-03-19T06:38:55.304 INFO:tasks.ceph:Scrubbing osd.6 2024-03-19T06:38:55.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:55.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.530+0000 7fa467400640 1 Processor -- start 2024-03-19T06:38:55.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.531+0000 7fa467400640 1 -- start start 2024-03-19T06:38:55.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.532+0000 7fa467400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa460151fa0 0x7fa4600c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.532+0000 7fa467400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa460157cf0 con 0x7fa46006d090 2024-03-19T06:38:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.532+0000 7fa467400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa460157f90 con 0x7fa46006ccb0 2024-03-19T06:38:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.532+0000 7fa467400640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa460158270 con 0x7fa460151fa0 2024-03-19T06:38:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.533+0000 7fa45fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa46006d090 0x7fa460151890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49306/0 (socket says 172.21.15.17:49306) 2024-03-19T06:38:55.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.534+0000 7fa45fe00640 1 -- 172.21.15.17:0/2170787552 learned_addr learned my addr 172.21.15.17:0/2170787552 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:55.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.534+0000 7fa465400640 1 --2- 172.21.15.17:0/2170787552 >> v2:172.21.15.153:3300/0 conn(0x7fa460151fa0 0x7fa4600c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.538+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644117790 0 0) 0x7fa460157cf0 con 0x7fa46006d090 2024-03-19T06:38:55.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.538+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa444003520 con 0x7fa46006d090 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.541+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918923106 0 0) 0x7fa444003520 con 0x7fa46006d090 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 >> v2:172.21.15.153:3300/0 conn(0x7fa460151fa0 msgr2=0x7fa4600c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 --2- 172.21.15.17:0/2170787552 >> v2:172.21.15.153:3300/0 conn(0x7fa460151fa0 0x7fa4600c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 >> v1:172.21.15.153:6789/0 conn(0x7fa46006ccb0 legacy=0x7fa4600c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa460158550 con 0x7fa46006d090 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fa44c001690 con 0x7fa46006d090 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 >> v1:172.21.15.17:6789/0 conn(0x7fa46006d090 legacy=0x7fa460151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444003a00 0x7fa444003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 0x7fa444004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4440051c0 0x7fa44400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460158270 con 0x7fa444004800 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400c0a0 con 0x7fa444003a00 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.542+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400c2a0 con 0x7fa4440051c0 2024-03-19T06:38:55.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.544+0000 7fa465400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4440051c0 0x7fa44400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.546+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 0x7fa444004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa45fe00640 1 -- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4440051c0 msgr2=0x7fa44400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa4440051c0 0x7fa44400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa45fe00640 1 -- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444003a00 msgr2=0x7fa444003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa444003a00 0x7fa444003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa45fe00640 1 -- 172.21.15.17:0/2170787552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa444003520 con 0x7fa444004800 2024-03-19T06:38:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.550+0000 7fa465400640 1 -- 172.21.15.17:0/2170787552 reap_dead start 2024-03-19T06:38:55.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.553+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 0x7fa444004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa460157ec0 tx=0x7fa444005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3616526b1105b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.558+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c007c40 con 0x7fa444004800 2024-03-19T06:38:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.558+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c030070 con 0x7fa444004800 2024-03-19T06:38:55.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.558+0000 7fa45f400640 1 -- 172.21.15.17:0/2170787552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c005d50 con 0x7fa444004800 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 -- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 msgr2=0x7fa444004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 0x7fa444004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa460157ec0 tx=0x7fa444005830 comp rx=0 tx=0).stop 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 -- 172.21.15.17:0/2170787552 shutdown_connections 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 --2- 172.21.15.17:0/2170787552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa444004800 0x7fa444004c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 -- 172.21.15.17:0/2170787552 >> 172.21.15.17:0/2170787552 conn(0x7fa46006b020 msgr2=0x7fa46006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 -- 172.21.15.17:0/2170787552 shutdown_connections 2024-03-19T06:38:55.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.559+0000 7fa467400640 1 -- 172.21.15.17:0/2170787552 wait complete. 2024-03-19T06:38:55.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.562+0000 7fa467400640 1 Processor -- start 2024-03-19T06:38:55.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.563+0000 7fa467400640 1 -- start start 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa444004800 0x7fa4601371e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 0x7fa46013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46013b650 0x7fa4601f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600c2b60 con 0x7fa460155070 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600c29e0 con 0x7fa46013b650 2024-03-19T06:38:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.564+0000 7fa467400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600c2ce0 con 0x7fa444004800 2024-03-19T06:38:55.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.565+0000 7fa45fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 0x7fa46013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.565+0000 7fa45fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 0x7fa46013b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33532/0 (socket says 172.21.15.17:33532) 2024-03-19T06:38:55.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.565+0000 7fa45fe00640 1 -- 172.21.15.17:0/2865320661 learned_addr learned my addr 172.21.15.17:0/2865320661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.566+0000 7fa464a00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa444004800 0x7fa4601371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.570+0000 7fa45fe00640 1 -- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa444004800 msgr2=0x7fa4601371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.570+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fa444004800 0x7fa4601371e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.570+0000 7fa45fe00640 1 -- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46013b650 msgr2=0x7fa4601f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.570+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa46013b650 0x7fa4601f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.570+0000 7fa45fe00640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46013bad0 con 0x7fa460155070 2024-03-19T06:38:55.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.573+0000 7fa45fe00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 0x7fa46013b110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa44c02c390 tx=0x7fa460158160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.578+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c046070 con 0x7fa460155070 2024-03-19T06:38:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.578+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c000ed0 con 0x7fa460155070 2024-03-19T06:38:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.578+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c001b80 con 0x7fa460155070 2024-03-19T06:38:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.578+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46013a390 con 0x7fa460155070 2024-03-19T06:38:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.578+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46013a630 con 0x7fa460155070 2024-03-19T06:38:55.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.579+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa460154cb0 con 0x7fa460155070 2024-03-19T06:38:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.604+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fa44c049070 con 0x7fa460155070 2024-03-19T06:38:55.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.605+0000 7fa45cc00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa44006bc20 0x7fa44006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.606+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fa44c0ac5e0 con 0x7fa460155070 2024-03-19T06:38:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.606+0000 7fa464a00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa44006bc20 0x7fa44006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.606+0000 7fa45cc00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7fa440075630 0x7fa440077ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.606+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4400781a0 con 0x7fa440075630 2024-03-19T06:38:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.607+0000 7fa465400640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7fa440075630 0x7fa440077ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.607+0000 7fa464a00640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa44006bc20 0x7fa44006e0e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa450007fd0 tx=0x7fa450009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.609+0000 7fa465400640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7fa440075630 0x7fa440077ad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.609+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa44c076970 con 0x7fa460155070 2024-03-19T06:38:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.611+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== osd.6 v2:172.21.15.153:6810/1824749759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa4400781a0 con 0x7fa440075630 2024-03-19T06:38:55.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.628+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 --> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa460069be0 con 0x7fa440075630 2024-03-19T06:38:55.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.629+0000 7fa45cc00640 1 -- 172.21.15.17:0/2865320661 <== osd.6 v2:172.21.15.153:6810/1824749759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa460069be0 con 0x7fa440075630 2024-03-19T06:38:55.615 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:55.615 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:55.615 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:55.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.629+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7fa440075630 msgr2=0x7fa440077ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.629+0000 7fa467400640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.153:6810/1824749759,v1:172.21.15.153:6812/1824749759] conn(0x7fa440075630 0x7fa440077ad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa44006bc20 msgr2=0x7fa44006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fa44006bc20 0x7fa44006e0e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa450007fd0 tx=0x7fa450009040 comp rx=0 tx=0).stop 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 msgr2=0x7fa46013b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 --2- 172.21.15.17:0/2865320661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa460155070 0x7fa46013b110 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa44c02c390 tx=0x7fa460158160 comp rx=0 tx=0).stop 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa465400640 1 -- 172.21.15.17:0/2865320661 reap_dead start 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 shutdown_connections 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 >> 172.21.15.17:0/2865320661 conn(0x7fa46006b020 msgr2=0x7fa4601500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 shutdown_connections 2024-03-19T06:38:55.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.630+0000 7fa467400640 1 -- 172.21.15.17:0/2865320661 wait complete. 2024-03-19T06:38:55.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-19T06:38:55.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.881+0000 7fabf5400640 1 Processor -- start 2024-03-19T06:38:55.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.881+0000 7fabf5400640 1 -- start start 2024-03-19T06:38:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.883+0000 7fabf5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 0x7fabf00c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.883+0000 7fabf5400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fabf00c6020 0x7fabf0158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.883+0000 7fabf5400640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabf006f8d0 con 0x7fabf0151f20 2024-03-19T06:38:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.883+0000 7fabf5400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabf006fb70 con 0x7fabf00c6020 2024-03-19T06:38:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.883+0000 7fabf5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf006fe50 con 0x7fabf006b430 2024-03-19T06:38:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.885+0000 7fabee800640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fabf0151f20 0x7fabf00c6dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:54320/0 (socket says 172.21.15.17:54320) 2024-03-19T06:38:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.885+0000 7fabee800640 1 -- 172.21.15.17:0/2691611039 learned_addr learned my addr 172.21.15.17:0/2691611039 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.885+0000 7fabede00640 1 --2- 172.21.15.17:0/2691611039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 0x7fabf00c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.891+0000 7fabed400640 1 -- 172.21.15.17:0/2691611039 <== mon.1 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121387735 0 0) 0x7fabf006f8d0 con 0x7fabf0151f20 2024-03-19T06:38:55.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.891+0000 7fabed400640 1 -- 172.21.15.17:0/2691611039 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabd4003520 con 0x7fabf0151f20 2024-03-19T06:38:55.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.893+0000 7fabede00640 1 -- 172.21.15.17:0/2691611039 >> v2:172.21.15.17:3300/0 conn(0x7fabf00c6020 msgr2=0x7fabf0158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:55.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.893+0000 7fabede00640 1 --2- 172.21.15.17:0/2691611039 >> v2:172.21.15.17:3300/0 conn(0x7fabf00c6020 0x7fabf0158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.893+0000 7fabede00640 1 -- 172.21.15.17:0/2691611039 >> v1:172.21.15.153:6789/0 conn(0x7fabf0151f20 legacy=0x7fabf00c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.893+0000 7fabede00640 1 -- 172.21.15.17:0/2691611039 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0070130 con 0x7fabf006b430 2024-03-19T06:38:55.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.899+0000 7fabede00640 1 --2- 172.21.15.17:0/2691611039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 0x7fabf00c5ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0097a0 tx=0x7fabdc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e207770b2966f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.908+0000 7fabed400640 1 -- 172.21.15.17:0/2691611039 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc034070 con 0x7fabf006b430 2024-03-19T06:38:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.911+0000 7fabed400640 1 -- 172.21.15.17:0/2691611039 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc030610 con 0x7fabf006b430 2024-03-19T06:38:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.911+0000 7fabed400640 1 -- 172.21.15.17:0/2691611039 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0309c0 con 0x7fabf006b430 2024-03-19T06:38:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 -- 172.21.15.17:0/2691611039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 msgr2=0x7fabf00c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 --2- 172.21.15.17:0/2691611039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 0x7fabf00c5ae0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0097a0 tx=0x7fabdc02b960 comp rx=0 tx=0).stop 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 -- 172.21.15.17:0/2691611039 shutdown_connections 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 --2- 172.21.15.17:0/2691611039 >> v2:172.21.15.17:3300/0 conn(0x7fabf00c6020 0x7fabf0158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 --2- 172.21.15.17:0/2691611039 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf006b430 0x7fabf00c5ae0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 -- 172.21.15.17:0/2691611039 >> 172.21.15.17:0/2691611039 conn(0x7fabf00673f0 msgr2=0x7fabf00cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 -- 172.21.15.17:0/2691611039 shutdown_connections 2024-03-19T06:38:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.912+0000 7fabf5400640 1 -- 172.21.15.17:0/2691611039 wait complete. 2024-03-19T06:38:55.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.914+0000 7fabf5400640 1 Processor -- start 2024-03-19T06:38:55.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.914+0000 7fabf5400640 1 -- start start 2024-03-19T06:38:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf006b430 0x7fabf0157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf00c6020 0x7fabf01f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01586e0 con 0x7fabf0151f20 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0158560 con 0x7fabf006b430 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.915+0000 7fabf5400640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0158860 con 0x7fabf00c6020 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.916+0000 7fabef200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.917+0000 7fabef200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33554/0 (socket says 172.21.15.17:33554) 2024-03-19T06:38:55.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.917+0000 7fabef200640 1 -- 172.21.15.17:0/3894829276 learned_addr learned my addr 172.21.15.17:0/3894829276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.917+0000 7fabee800640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf006b430 0x7fabf0157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.921+0000 7fabef200640 1 -- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf00c6020 msgr2=0x7fabf01f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.921+0000 7fabef200640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf00c6020 0x7fabf01f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.921+0000 7fabef200640 1 -- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf006b430 msgr2=0x7fabf0157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.921+0000 7fabef200640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf006b430 0x7fabf0157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.921+0000 7fabef200640 1 -- 172.21.15.17:0/3894829276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf01e3750 con 0x7fabf0151f20 2024-03-19T06:38:55.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.924+0000 7fabef200640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b9a0 tx=0x7fabe800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:55.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.934+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8019070 con 0x7fabf0151f20 2024-03-19T06:38:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.934+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe800cbc0 con 0x7fabf0151f20 2024-03-19T06:38:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.934+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe8014440 con 0x7fabf0151f20 2024-03-19T06:38:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.934+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf01e39d0 con 0x7fabf0151f20 2024-03-19T06:38:55.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.934+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf0152640 con 0x7fabf0151f20 2024-03-19T06:38:55.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.936+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf0152430 con 0x7fabf0151f20 2024-03-19T06:38:55.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.970+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fabe801c070 con 0x7fabf0151f20 2024-03-19T06:38:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.972+0000 7fabe6a00640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 0x7fabd006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.972+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fabe808af00 con 0x7fabf0151f20 2024-03-19T06:38:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.972+0000 7fabee800640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 0x7fabd006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:55.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:55.974+0000 7fabee800640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 0x7fabd006e0e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005880 tx=0x7fabe0009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:56.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.337+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fabe8023020 con 0x7fabf0151f20 2024-03-19T06:38:56.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.566+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fabf0067d60 con 0x7fabd006bc20 2024-03-19T06:38:56.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.567+0000 7fabe6a00640 1 -- 172.21.15.17:0/3894829276 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fabf0067d60 con 0x7fabd006bc20 2024-03-19T06:38:56.552 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 msgr2=0x7fabd006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 0x7fabd006e0e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fabe0005880 tx=0x7fabe0009040 comp rx=0 tx=0).stop 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 msgr2=0x7fabf01f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b9a0 tx=0x7fabe800be60 comp rx=0 tx=0).stop 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 shutdown_connections 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabf0151f20 0x7fabf01f3900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fabf00c6020 0x7fabf01f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fabd006bc20 0x7fabd006e0e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 --2- 172.21.15.17:0/3894829276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf006b430 0x7fabf0157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 >> 172.21.15.17:0/3894829276 conn(0x7fabf00673f0 msgr2=0x7fabf00cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 shutdown_connections 2024-03-19T06:38:56.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.570+0000 7fabf5400640 1 -- 172.21.15.17:0/3894829276 wait complete. 2024-03-19T06:38:56.576 INFO:tasks.ceph:Scrubbing osd.7 2024-03-19T06:38:56.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-19T06:38:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.823+0000 7f5abb200640 1 Processor -- start 2024-03-19T06:38:56.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.823+0000 7f5abb200640 1 -- start start 2024-03-19T06:38:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.825+0000 7f5abb200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5ab406ccb0 0x7f5ab40c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.825+0000 7f5abb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 0x7f5ab40c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.825+0000 7f5abb200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab4157cf0 con 0x7f5ab40c79b0 2024-03-19T06:38:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.825+0000 7f5abb200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab4157f90 con 0x7f5ab406ccb0 2024-03-19T06:38:56.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.825+0000 7f5abb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4158270 con 0x7f5ab406d090 2024-03-19T06:38:56.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.828+0000 7f5aab400640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 0x7f5ab40c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.828+0000 7f5ab9200640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5ab40c79b0 0x7f5ab4151890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:54322/0 (socket says 172.21.15.17:54322) 2024-03-19T06:38:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.828+0000 7f5ab9200640 1 -- 172.21.15.17:0/3496370861 learned_addr learned my addr 172.21.15.17:0/3496370861 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:56.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.829+0000 7f5ab3e00640 1 --2- 172.21.15.17:0/3496370861 >> v2:172.21.15.153:3300/0 conn(0x7f5ab406ccb0 0x7f5ab40c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.835+0000 7f5aab400640 1 -- 172.21.15.17:0/3496370861 >> v2:172.21.15.153:3300/0 conn(0x7f5ab406ccb0 msgr2=0x7f5ab40c29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.835+0000 7f5aab400640 1 --2- 172.21.15.17:0/3496370861 >> v2:172.21.15.153:3300/0 conn(0x7f5ab406ccb0 0x7f5ab40c29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.835+0000 7f5aab400640 1 -- 172.21.15.17:0/3496370861 >> v1:172.21.15.153:6789/0 conn(0x7f5ab40c79b0 legacy=0x7f5ab4151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.835+0000 7f5aab400640 1 -- 172.21.15.17:0/3496370861 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4158550 con 0x7f5ab406d090 2024-03-19T06:38:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.841+0000 7f5aab400640 1 --2- 172.21.15.17:0/3496370861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 0x7f5ab40c7470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0097a0 tx=0x7f5a9c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941e95e5f78e69f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:56.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.851+0000 7f5ab3400640 1 -- 172.21.15.17:0/3496370861 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c034070 con 0x7f5ab406d090 2024-03-19T06:38:56.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.851+0000 7f5ab3400640 1 -- 172.21.15.17:0/3496370861 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c030610 con 0x7f5ab406d090 2024-03-19T06:38:56.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.851+0000 7f5ab3400640 1 -- 172.21.15.17:0/3496370861 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c0309e0 con 0x7f5ab406d090 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.851+0000 7f5abb200640 1 -- 172.21.15.17:0/3496370861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 msgr2=0x7f5ab40c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.851+0000 7f5abb200640 1 --2- 172.21.15.17:0/3496370861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 0x7f5ab40c7470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0097a0 tx=0x7f5a9c02b960 comp rx=0 tx=0).stop 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 -- 172.21.15.17:0/3496370861 shutdown_connections 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 --2- 172.21.15.17:0/3496370861 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab406d090 0x7f5ab40c7470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 --2- 172.21.15.17:0/3496370861 >> v2:172.21.15.153:3300/0 conn(0x7f5ab406ccb0 0x7f5ab40c29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 -- 172.21.15.17:0/3496370861 >> 172.21.15.17:0/3496370861 conn(0x7f5ab406b020 msgr2=0x7f5ab406b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 -- 172.21.15.17:0/3496370861 shutdown_connections 2024-03-19T06:38:56.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.852+0000 7f5abb200640 1 -- 172.21.15.17:0/3496370861 wait complete. 2024-03-19T06:38:56.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.854+0000 7f5abb200640 1 Processor -- start 2024-03-19T06:38:56.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.854+0000 7f5abb200640 1 -- start start 2024-03-19T06:38:56.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 0x7f5ab40ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab406d090 0x7f5ab414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab40c79b0 0x7f5ab413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4152120 con 0x7f5ab406ccb0 2024-03-19T06:38:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4151fa0 con 0x7f5ab406d090 2024-03-19T06:38:56.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.855+0000 7f5abb200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab406e400 con 0x7f5ab40c79b0 2024-03-19T06:38:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.856+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 0x7f5ab40ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.856+0000 7f5ab3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 0x7f5ab40ca3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33558/0 (socket says 172.21.15.17:33558) 2024-03-19T06:38:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.856+0000 7f5ab3e00640 1 -- 172.21.15.17:0/4020018244 learned_addr learned my addr 172.21.15.17:0/4020018244 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:56.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.857+0000 7f5aab400640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab406d090 0x7f5ab414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.858+0000 7f5ab9200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab40c79b0 0x7f5ab413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.861+0000 7f5ab3e00640 1 -- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab40c79b0 msgr2=0x7f5ab413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.861+0000 7f5ab3e00640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f5ab40c79b0 0x7f5ab413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.861+0000 7f5ab3e00640 1 -- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab406d090 msgr2=0x7f5ab414f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.861+0000 7f5ab3e00640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab406d090 0x7f5ab414f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.861+0000 7f5ab3e00640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40c9310 con 0x7f5ab406ccb0 2024-03-19T06:38:56.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.864+0000 7f5ab3e00640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 0x7f5ab40ca3b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400efc0 tx=0x7f5aa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:56.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.869+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4018020 con 0x7f5ab406ccb0 2024-03-19T06:38:56.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.869+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa4014480 con 0x7f5ab406ccb0 2024-03-19T06:38:56.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.869+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4014850 con 0x7f5ab406ccb0 2024-03-19T06:38:56.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.869+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab40c95f0 con 0x7f5ab406ccb0 2024-03-19T06:38:56.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.870+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40c9bb0 con 0x7f5ab406ccb0 2024-03-19T06:38:56.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.871+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ab40c90c0 con 0x7f5ab406ccb0 2024-03-19T06:38:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.899+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f5aa4005d10 con 0x7f5ab406ccb0 2024-03-19T06:38:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.900+0000 7f5ab0c00640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f5a9006bc20 0x7f5a9006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.900+0000 7f5aab400640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f5a9006bc20 0x7f5a9006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.902+0000 7f5aab400640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f5a9006bc20 0x7f5a9006e0e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c036000 tx=0x7f5a9c03b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.903+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5aa40580d0 con 0x7f5ab406ccb0 2024-03-19T06:38:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.903+0000 7f5ab0c00640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7f5a90075640 0x7f5a90077ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.903+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5aa400df90 con 0x7f5a90075640 2024-03-19T06:38:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.903+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5aa40562d0 con 0x7f5ab406ccb0 2024-03-19T06:38:56.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.904+0000 7f5ab9200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7f5a90075640 0x7f5a90077ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:56.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.905+0000 7f5ab9200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7f5a90075640 0x7f5a90077ae0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:56.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.908+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== osd.7 v2:172.21.15.153:6824/3824547311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5aa400df90 con 0x7f5a90075640 2024-03-19T06:38:56.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.927+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 --> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ab4069be0 con 0x7f5a90075640 2024-03-19T06:38:56.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5ab0c00640 1 -- 172.21.15.17:0/4020018244 <== osd.7 v2:172.21.15.153:6824/3824547311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5ab4069be0 con 0x7f5a90075640 2024-03-19T06:38:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-19T06:38:56.913 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-19T06:38:56.913 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-19T06:38:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7f5a90075640 msgr2=0x7f5a90077ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.153:6824/3824547311,v1:172.21.15.153:6825/3824547311] conn(0x7f5a90075640 0x7f5a90077ae0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f5a9006bc20 msgr2=0x7f5a9006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f5a9006bc20 0x7f5a9006e0e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c036000 tx=0x7f5a9c03b040 comp rx=0 tx=0).stop 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 msgr2=0x7f5ab40ca3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 --2- 172.21.15.17:0/4020018244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab406ccb0 0x7f5ab40ca3b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400efc0 tx=0x7f5aa400c490 comp rx=0 tx=0).stop 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5ab9200640 1 -- 172.21.15.17:0/4020018244 reap_dead start 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 shutdown_connections 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 >> 172.21.15.17:0/4020018244 conn(0x7f5ab406b020 msgr2=0x7f5ab41509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 shutdown_connections 2024-03-19T06:38:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:56.929+0000 7f5abb200640 1 -- 172.21.15.17:0/4020018244 wait complete. 2024-03-19T06:38:56.939 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-19T06:38:57.131 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:38:57.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:38:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.178+0000 7fddede00640 1 Processor -- start 2024-03-19T06:38:57.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.178+0000 7fddede00640 1 -- start start 2024-03-19T06:38:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.179+0000 7fddede00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdde81541d0 0x7fdde80ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.179+0000 7fddede00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdde815d860 0x7fdde815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.179+0000 7fddede00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde815d3b0 con 0x7fdde80cb8d0 2024-03-19T06:38:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.179+0000 7fddede00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde815e1d0 con 0x7fdde815d860 2024-03-19T06:38:57.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.179+0000 7fddede00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde815a0d0 con 0x7fdde81541d0 2024-03-19T06:38:57.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.180+0000 7fdde7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdde815d860 0x7fdde815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.181+0000 7fdde6a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdde81541d0 0x7fdde80ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.181+0000 7fdde6000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdde80cb8d0 0x7fdde80cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:49310/0 (socket says 172.21.15.17:49310) 2024-03-19T06:38:57.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.181+0000 7fdde6000640 1 -- 172.21.15.17:0/2152619217 learned_addr learned my addr 172.21.15.17:0/2152619217 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.185+0000 7fdde6a00640 1 -- 172.21.15.17:0/2152619217 >> v2:172.21.15.17:3300/0 conn(0x7fdde815d860 msgr2=0x7fdde815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.185+0000 7fdde6a00640 1 --2- 172.21.15.17:0/2152619217 >> v2:172.21.15.17:3300/0 conn(0x7fdde815d860 0x7fdde815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.185+0000 7fdde6a00640 1 -- 172.21.15.17:0/2152619217 >> v1:172.21.15.17:6789/0 conn(0x7fdde80cb8d0 legacy=0x7fdde80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.185+0000 7fdde6a00640 1 -- 172.21.15.17:0/2152619217 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde815a3b0 con 0x7fdde81541d0 2024-03-19T06:38:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.188+0000 7fdde6a00640 1 --2- 172.21.15.17:0/2152619217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde81541d0 0x7fdde80ca2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdde808cb70 tx=0x7fddd802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a612ffcc3a660c82 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.194+0000 7fdde5600640 1 -- 172.21.15.17:0/2152619217 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8034070 con 0x7fdde81541d0 2024-03-19T06:38:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.194+0000 7fdde5600640 1 -- 172.21.15.17:0/2152619217 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8030610 con 0x7fdde81541d0 2024-03-19T06:38:57.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.194+0000 7fdde5600640 1 -- 172.21.15.17:0/2152619217 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd80309e0 con 0x7fdde81541d0 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 -- 172.21.15.17:0/2152619217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde81541d0 msgr2=0x7fdde80ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 --2- 172.21.15.17:0/2152619217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde81541d0 0x7fdde80ca2a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdde808cb70 tx=0x7fddd802b960 comp rx=0 tx=0).stop 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 -- 172.21.15.17:0/2152619217 shutdown_connections 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 --2- 172.21.15.17:0/2152619217 >> v2:172.21.15.17:3300/0 conn(0x7fdde815d860 0x7fdde815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 --2- 172.21.15.17:0/2152619217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde81541d0 0x7fdde80ca2a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 -- 172.21.15.17:0/2152619217 >> 172.21.15.17:0/2152619217 conn(0x7fdde806baf0 msgr2=0x7fdde806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 -- 172.21.15.17:0/2152619217 shutdown_connections 2024-03-19T06:38:57.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.195+0000 7fddede00640 1 -- 172.21.15.17:0/2152619217 wait complete. 2024-03-19T06:38:57.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.197+0000 7fddede00640 1 Processor -- start 2024-03-19T06:38:57.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.197+0000 7fddede00640 1 -- start start 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde80cb8d0 0x7fdde80c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde815d860 0x7fdde81efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8159da0 con 0x7fdde81541d0 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde815a970 con 0x7fdde815d860 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.198+0000 7fddede00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde815ac50 con 0x7fdde80cb8d0 2024-03-19T06:38:57.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.199+0000 7fdde6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.199+0000 7fdde7400640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde815d860 0x7fdde81efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.199+0000 7fdde6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33584/0 (socket says 172.21.15.17:33584) 2024-03-19T06:38:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.199+0000 7fdde6000640 1 -- 172.21.15.17:0/3153476503 learned_addr learned my addr 172.21.15.17:0/3153476503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:57.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.199+0000 7fdde6a00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde80cb8d0 0x7fdde80c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.203+0000 7fdde6000640 1 -- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde80cb8d0 msgr2=0x7fdde80c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.203+0000 7fdde6000640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde80cb8d0 0x7fdde80c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.203+0000 7fdde6000640 1 -- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde815d860 msgr2=0x7fdde81efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.203+0000 7fdde6000640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde815d860 0x7fdde81efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.203+0000 7fdde6000640 1 -- 172.21.15.17:0/3153476503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde81e51a0 con 0x7fdde81541d0 2024-03-19T06:38:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.206+0000 7fdde6000640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c430 tx=0x7fddd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.210+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4017070 con 0x7fdde81541d0 2024-03-19T06:38:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.211+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4005ce0 con 0x7fdde81541d0 2024-03-19T06:38:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.211+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde81e4ec0 con 0x7fdde81541d0 2024-03-19T06:38:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.211+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40072f0 con 0x7fdde81541d0 2024-03-19T06:38:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.211+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde814de30 con 0x7fdde81541d0 2024-03-19T06:38:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.212+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde8069be0 con 0x7fdde81541d0 2024-03-19T06:38:57.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.238+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fddd401a070 con 0x7fdde81541d0 2024-03-19T06:38:57.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.239+0000 7fdddf400640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 0x7fddc806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.240+0000 7fdde6a00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 0x7fddc806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:57.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.240+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fddd4056760 con 0x7fdde81541d0 2024-03-19T06:38:57.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.241+0000 7fdde6a00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 0x7fddc806e110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fddd8036000 tx=0x7fddd803b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.548+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fddd4021020 con 0x7fdde81541d0 2024-03-19T06:38:57.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.769+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fdde80b2490 con 0x7fddc806bc50 2024-03-19T06:38:57.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.770+0000 7fdddf400640 1 -- 172.21.15.17:0/3153476503 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fdde80b2490 con 0x7fddc806bc50 2024-03-19T06:38:57.756 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-03-19T06:38:57.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 msgr2=0x7fddc806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 0x7fddc806e110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fddd8036000 tx=0x7fddd803b040 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 msgr2=0x7fdde81e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c430 tx=0x7fddd400c8f0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 shutdown_connections 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fddc806bc50 0x7fddc806e110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdde815d860 0x7fdde81efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdde81541d0 0x7fdde81e3360 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 --2- 172.21.15.17:0/3153476503 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fdde80cb8d0 0x7fdde80c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.773+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 >> 172.21.15.17:0/3153476503 conn(0x7fdde806baf0 msgr2=0x7fdde80cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.774+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 shutdown_connections 2024-03-19T06:38:57.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:57.774+0000 7fddede00640 1 -- 172.21.15.17:0/3153476503 wait complete. 2024-03-19T06:38:57.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:38:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.007+0000 7f629b200640 1 Processor -- start 2024-03-19T06:38:57.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.007+0000 7f629b200640 1 -- start start 2024-03-19T06:38:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.008+0000 7f629b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f629c0b5110 0x7f629c0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.008+0000 7f629b200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f629c0c69f0 0x7f629c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.008+0000 7f629b200640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629c159eb0 con 0x7f629c153f10 2024-03-19T06:38:57.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.008+0000 7f629b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c0cbc30 con 0x7f629c0b5110 2024-03-19T06:38:57.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.008+0000 7f629b200640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f629c15a190 con 0x7f629c0c69f0 2024-03-19T06:38:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.011+0000 7f6299e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f629c153f10 0x7f629c0ca0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:54330/0 (socket says 172.21.15.17:54330) 2024-03-19T06:38:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.011+0000 7f6299e00640 1 -- 172.21.15.17:0/128105529 learned_addr learned my addr 172.21.15.17:0/128105529 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:38:57.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.012+0000 7f629a800640 1 --2- 172.21.15.17:0/128105529 >> v2:172.21.15.153:3300/0 conn(0x7f629c0c69f0 0x7f629c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.016+0000 7f6291400640 1 --2- 172.21.15.17:0/128105529 >> v2:172.21.15.17:3300/0 conn(0x7f629c0b5110 0x7f629c0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.019+0000 7f6291400640 1 -- 172.21.15.17:0/128105529 >> v2:172.21.15.153:3300/0 conn(0x7f629c0c69f0 msgr2=0x7f629c0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:38:58.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.019+0000 7f6291400640 1 --2- 172.21.15.17:0/128105529 >> v2:172.21.15.153:3300/0 conn(0x7f629c0c69f0 0x7f629c0c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.019+0000 7f6291400640 1 -- 172.21.15.17:0/128105529 >> v1:172.21.15.153:6789/0 conn(0x7f629c153f10 legacy=0x7f629c0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.019+0000 7f6291400640 1 -- 172.21.15.17:0/128105529 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c15a470 con 0x7f629c0b5110 2024-03-19T06:38:58.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.022+0000 7f6291400640 1 --2- 172.21.15.17:0/128105529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c0b5110 0x7f629c0c78a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f629c08d010 tx=0x7f628402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9afb76397a6bf83 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.036+0000 7f6299400640 1 -- 172.21.15.17:0/128105529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6284034070 con 0x7f629c0b5110 2024-03-19T06:38:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.036+0000 7f6299400640 1 -- 172.21.15.17:0/128105529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6284030610 con 0x7f629c0b5110 2024-03-19T06:38:58.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.036+0000 7f6299400640 1 -- 172.21.15.17:0/128105529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62840309e0 con 0x7f629c0b5110 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 -- 172.21.15.17:0/128105529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c0b5110 msgr2=0x7f629c0c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 --2- 172.21.15.17:0/128105529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c0b5110 0x7f629c0c78a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f629c08d010 tx=0x7f628402b960 comp rx=0 tx=0).stop 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 -- 172.21.15.17:0/128105529 shutdown_connections 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 --2- 172.21.15.17:0/128105529 >> v2:172.21.15.153:3300/0 conn(0x7f629c0c69f0 0x7f629c0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 --2- 172.21.15.17:0/128105529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c0b5110 0x7f629c0c78a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 -- 172.21.15.17:0/128105529 >> 172.21.15.17:0/128105529 conn(0x7f629c0cf340 msgr2=0x7f629c0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:58.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 -- 172.21.15.17:0/128105529 shutdown_connections 2024-03-19T06:38:58.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.037+0000 7f629b200640 1 -- 172.21.15.17:0/128105529 wait complete. 2024-03-19T06:38:58.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.040+0000 7f629b200640 1 Processor -- start 2024-03-19T06:38:58.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.040+0000 7f629b200640 1 -- start start 2024-03-19T06:38:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.041+0000 7f629b200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f629c0c69f0 0x7f629c0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.041+0000 7f629b200640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f629c153f10 0x7f629c0c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.042+0000 7f629b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:58.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.042+0000 7f629b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c159b80 con 0x7f629c152f50 2024-03-19T06:38:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.042+0000 7f629b200640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629c15aa30 con 0x7f629c153f10 2024-03-19T06:38:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.042+0000 7f629b200640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f629c0ca7d0 con 0x7f629c0c69f0 2024-03-19T06:38:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.042+0000 7f629a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.043+0000 7f629a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33604/0 (socket says 172.21.15.17:33604) 2024-03-19T06:38:58.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.043+0000 7f629a800640 1 -- 172.21.15.17:0/2155643083 learned_addr learned my addr 172.21.15.17:0/2155643083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:38:58.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.043+0000 7f6291400640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f629c153f10 0x7f629c0c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.044+0000 7f6299e00640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f629c0c69f0 0x7f629c0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.047+0000 7f629a800640 1 -- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f629c0c69f0 msgr2=0x7f629c0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.047+0000 7f629a800640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f629c0c69f0 0x7f629c0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.047+0000 7f629a800640 1 -- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f629c153f10 msgr2=0x7f629c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.047+0000 7f629a800640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f629c153f10 0x7f629c0c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.047+0000 7f629a800640 1 -- 172.21.15.17:0/2155643083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0c5a10 con 0x7f629c152f50 2024-03-19T06:38:58.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.049+0000 7f629a800640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6294009dd0 tx=0x7f629400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.054+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294018020 con 0x7f629c152f50 2024-03-19T06:38:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.054+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6294014480 con 0x7f629c152f50 2024-03-19T06:38:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.054+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294014870 con 0x7f629c152f50 2024-03-19T06:38:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.054+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f629c0c5cf0 con 0x7f629c152f50 2024-03-19T06:38:58.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.054+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f629c1f1020 con 0x7f629c152f50 2024-03-19T06:38:58.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.055+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629c0c9250 con 0x7f629c152f50 2024-03-19T06:38:58.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.087+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f6294005d10 con 0x7f629c152f50 2024-03-19T06:38:58.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.088+0000 7f6292a00640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 0x7f627806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:38:58.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.089+0000 7f6299e00640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 0x7f627806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:38:58.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.090+0000 7f6299e00640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 0x7f627806e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f628c007fd0 tx=0x7f628c007e80 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:38:58.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.093+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6294058490 con 0x7f629c152f50 2024-03-19T06:38:58.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.437+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f629c0c9250 con 0x7f629c152f50 2024-03-19T06:38:58.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.665+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f629c04f050 con 0x7f627806bc50 2024-03-19T06:38:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.679+0000 7f6292a00640 1 -- 172.21.15.17:0/2155643083 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+330130 (secure 0 0 0) 0x7f629c04f050 con 0x7f627806bc50 2024-03-19T06:38:58.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:38:58.672 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:38:58.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 msgr2=0x7f627806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 0x7f627806e110 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f628c007fd0 tx=0x7f628c007e80 comp rx=0 tx=0).stop 2024-03-19T06:38:58.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 msgr2=0x7f629c1f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:38:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6294009dd0 tx=0x7f629400c490 comp rx=0 tx=0).stop 2024-03-19T06:38:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 shutdown_connections 2024-03-19T06:38:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f629c152f50 0x7f629c1f1820 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f627806bc50 0x7f627806e110 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f629c153f10 0x7f629c0c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 --2- 172.21.15.17:0/2155643083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f629c0c69f0 0x7f629c0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:38:58.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 >> 172.21.15.17:0/2155643083 conn(0x7f629c0cf340 msgr2=0x7f629c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:38:58.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 shutdown_connections 2024-03-19T06:38:58.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:38:58.688+0000 7f629b200640 1 -- 172.21.15.17:0/2155643083 wait complete. 2024-03-19T06:38:58.699 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":1009,"stamp":"2024-03-19T06:38:58.251538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22602369,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":597,"num_read_kb":611,"num_write":9426,"num_write_kb":277524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9454,"ondisk_log_size":9454,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":321416,"kb_used_data":47048,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754653304,"statfs":{"total":773094113280,"available":772764983296,"internally_reserved":0,"allocated":48177152,"data_stored":46337530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":280874544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004170"},"pg_stats":[{"pgid":"2.1f","version":"32'665","reported_seq":722,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.716086+0000","last_change":"2024-03-19T06:38:51.716140+0000","last_active":"2024-03-19T06:38:51.716086+0000","last_peered":"2024-03-19T06:38:51.716086+0000","last_clean":"2024-03-19T06:38:51.716086+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:38:51.716086+0000","last_undegraded":"2024-03-19T06:38:51.716086+0000","last_fullsized":"2024-03-19T06:38:51.716086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'665","last_scrub_stamp":"2024-03-19T06:38:51.715990+0000","last_deep_scrub":"32'665","last_deep_scrub_stamp":"2024-03-19T06:38:51.715990+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.715990+0000","objects_scrubbed":7,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:50:57.164026+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'15","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:43.103382+0000","last_change":"2024-03-19T06:06:34.327598+0000","last_active":"2024-03-19T06:38:43.103382+0000","last_peered":"2024-03-19T06:38:43.103382+0000","last_clean":"2024-03-19T06:38:43.103382+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:38:43.103382+0000","last_undegraded":"2024-03-19T06:38:43.103382+0000","last_fullsized":"2024-03-19T06:38:43.103382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'60","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:13.099219+0000","last_change":"2024-03-19T06:06:42.445188+0000","last_active":"2024-03-19T06:38:13.099219+0000","last_peered":"2024-03-19T06:38:13.099219+0000","last_clean":"2024-03-19T06:38:13.099219+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:38:13.099219+0000","last_undegraded":"2024-03-19T06:38:13.099219+0000","last_fullsized":"2024-03-19T06:38:13.099219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'93","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.255477+0000","last_change":"2024-03-19T06:38:57.255519+0000","last_active":"2024-03-19T06:38:57.255477+0000","last_peered":"2024-03-19T06:38:57.255477+0000","last_clean":"2024-03-19T06:38:57.255477+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:38:57.255477+0000","last_undegraded":"2024-03-19T06:38:57.255477+0000","last_fullsized":"2024-03-19T06:38:57.255477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-03-19T06:38:57.255358+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-03-19T06:38:57.255358+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.255358+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:50:44.840418+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":914551,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'23","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.666450+0000","last_change":"2024-03-19T06:38:56.666508+0000","last_active":"2024-03-19T06:38:56.666450+0000","last_peered":"2024-03-19T06:38:56.666450+0000","last_clean":"2024-03-19T06:38:56.666450+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:38:56.666450+0000","last_undegraded":"2024-03-19T06:38:56.666450+0000","last_fullsized":"2024-03-19T06:38:56.666450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:38:56.666275+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:38:56.666275+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.666275+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:56:41.886024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'63","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:08.155860+0000","last_change":"2024-03-19T06:06:42.159840+0000","last_active":"2024-03-19T06:38:08.155860+0000","last_peered":"2024-03-19T06:38:08.155860+0000","last_clean":"2024-03-19T06:38:08.155860+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:38:08.155860+0000","last_undegraded":"2024-03-19T06:38:08.155860+0000","last_fullsized":"2024-03-19T06:38:08.155860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:17.097803+0000","last_change":"2024-03-19T06:06:33.105623+0000","last_active":"2024-03-19T06:38:17.097803+0000","last_peered":"2024-03-19T06:38:17.097803+0000","last_clean":"2024-03-19T06:38:17.097803+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:38:17.097803+0000","last_undegraded":"2024-03-19T06:38:17.097803+0000","last_fullsized":"2024-03-19T06:38:17.097803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.086073+0000","last_change":"2024-03-19T06:06:34.536503+0000","last_active":"2024-03-19T06:38:37.086073+0000","last_peered":"2024-03-19T06:38:37.086073+0000","last_clean":"2024-03-19T06:38:37.086073+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:38:37.086073+0000","last_undegraded":"2024-03-19T06:38:37.086073+0000","last_fullsized":"2024-03-19T06:38:37.086073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'72","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.511340+0000","last_change":"2024-03-19T06:07:02.159056+0000","last_active":"2024-03-19T06:37:18.511340+0000","last_peered":"2024-03-19T06:37:18.511340+0000","last_clean":"2024-03-19T06:37:18.511340+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:37:18.511340+0000","last_undegraded":"2024-03-19T06:37:18.511340+0000","last_fullsized":"2024-03-19T06:37:18.511340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:23.534708+0000","last_change":"2024-03-19T06:06:33.098782+0000","last_active":"2024-03-19T06:38:23.534708+0000","last_peered":"2024-03-19T06:38:23.534708+0000","last_clean":"2024-03-19T06:38:23.534708+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:38:23.534708+0000","last_undegraded":"2024-03-19T06:38:23.534708+0000","last_fullsized":"2024-03-19T06:38:23.534708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'31","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.062209+0000","last_change":"2024-03-19T06:06:34.538408+0000","last_active":"2024-03-19T06:38:37.062209+0000","last_peered":"2024-03-19T06:38:37.062209+0000","last_clean":"2024-03-19T06:38:37.062209+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:38:37.062209+0000","last_undegraded":"2024-03-19T06:38:37.062209+0000","last_fullsized":"2024-03-19T06:38:37.062209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'76","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.889675+0000","last_change":"2024-03-19T06:06:42.171975+0000","last_active":"2024-03-19T06:37:17.889675+0000","last_peered":"2024-03-19T06:37:17.889675+0000","last_clean":"2024-03-19T06:37:17.889675+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:37:17.889675+0000","last_undegraded":"2024-03-19T06:37:17.889675+0000","last_fullsized":"2024-03-19T06:37:17.889675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'18","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.266939+0000","last_change":"2024-03-19T06:06:34.341768+0000","last_active":"2024-03-19T06:38:37.266939+0000","last_peered":"2024-03-19T06:38:37.266939+0000","last_clean":"2024-03-19T06:38:37.266939+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:38:37.266939+0000","last_undegraded":"2024-03-19T06:38:37.266939+0000","last_fullsized":"2024-03-19T06:38:37.266939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'679","reported_seq":727,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:10.839358+0000","last_change":"2024-03-19T06:06:33.100194+0000","last_active":"2024-03-19T06:38:10.839358+0000","last_peered":"2024-03-19T06:38:10.839358+0000","last_clean":"2024-03-19T06:38:10.839358+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:38:10.839358+0000","last_undegraded":"2024-03-19T06:38:10.839358+0000","last_fullsized":"2024-03-19T06:38:10.839358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":679,"log_dups_size":0,"ondisk_log_size":679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'61","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:13.156845+0000","last_change":"2024-03-19T06:06:42.174383+0000","last_active":"2024-03-19T06:38:13.156845+0000","last_peered":"2024-03-19T06:38:13.156845+0000","last_clean":"2024-03-19T06:38:13.156845+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:38:13.156845+0000","last_undegraded":"2024-03-19T06:38:13.156845+0000","last_fullsized":"2024-03-19T06:38:13.156845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174160+0000","last_change":"2024-03-19T06:06:34.320640+0000","last_active":"2024-03-19T06:38:37.174160+0000","last_peered":"2024-03-19T06:38:37.174160+0000","last_clean":"2024-03-19T06:38:37.174160+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:38:37.174160+0000","last_undegraded":"2024-03-19T06:38:37.174160+0000","last_fullsized":"2024-03-19T06:38:37.174160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.348653+0000","last_change":"2024-03-19T06:38:53.348718+0000","last_active":"2024-03-19T06:38:53.348653+0000","last_peered":"2024-03-19T06:38:53.348653+0000","last_clean":"2024-03-19T06:38:53.348653+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:38:53.348653+0000","last_undegraded":"2024-03-19T06:38:53.348653+0000","last_fullsized":"2024-03-19T06:38:53.348653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-19T06:38:53.348493+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-19T06:38:53.348493+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.348493+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:51:35.882331+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'90","reported_seq":126,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:13.156801+0000","last_change":"2024-03-19T06:06:42.159813+0000","last_active":"2024-03-19T06:38:13.156801+0000","last_peered":"2024-03-19T06:38:13.156801+0000","last_clean":"2024-03-19T06:38:13.156801+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:38:13.156801+0000","last_undegraded":"2024-03-19T06:38:13.156801+0000","last_fullsized":"2024-03-19T06:38:13.156801+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":8470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'19","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.308843+0000","last_change":"2024-03-19T06:38:55.308972+0000","last_active":"2024-03-19T06:38:55.308843+0000","last_peered":"2024-03-19T06:38:55.308843+0000","last_clean":"2024-03-19T06:38:55.308843+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:38:55.308843+0000","last_undegraded":"2024-03-19T06:38:55.308843+0000","last_fullsized":"2024-03-19T06:38:55.308843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:55.308676+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:55.308676+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.308676+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:27:10.912005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.358513+0000","last_change":"2024-03-19T06:38:56.358670+0000","last_active":"2024-03-19T06:38:56.358513+0000","last_peered":"2024-03-19T06:38:56.358513+0000","last_clean":"2024-03-19T06:38:56.358513+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:38:56.358513+0000","last_undegraded":"2024-03-19T06:38:56.358513+0000","last_fullsized":"2024-03-19T06:38:56.358513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-03-19T06:38:56.358155+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-03-19T06:38:56.358155+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.358155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:56:41.577904+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'65","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:17.297663+0000","last_change":"2024-03-19T06:06:42.448163+0000","last_active":"2024-03-19T06:38:17.297663+0000","last_peered":"2024-03-19T06:38:17.297663+0000","last_clean":"2024-03-19T06:38:17.297663+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:38:17.297663+0000","last_undegraded":"2024-03-19T06:38:17.297663+0000","last_fullsized":"2024-03-19T06:38:17.297663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":11230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'17","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.359938+0000","last_change":"2024-03-19T06:38:57.360085+0000","last_active":"2024-03-19T06:38:57.359938+0000","last_peered":"2024-03-19T06:38:57.359938+0000","last_clean":"2024-03-19T06:38:57.359938+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:38:57.359938+0000","last_undegraded":"2024-03-19T06:38:57.359938+0000","last_fullsized":"2024-03-19T06:38:57.359938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:38:57.359737+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:38:57.359737+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.359737+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:47:45.089657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'9","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.110508+0000","last_change":"2024-03-19T06:06:33.099013+0000","last_active":"2024-03-19T06:38:16.110508+0000","last_peered":"2024-03-19T06:38:16.110508+0000","last_clean":"2024-03-19T06:38:16.110508+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:38:16.110508+0000","last_undegraded":"2024-03-19T06:38:16.110508+0000","last_fullsized":"2024-03-19T06:38:16.110508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'67","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:13.156867+0000","last_change":"2024-03-19T06:06:42.159000+0000","last_active":"2024-03-19T06:38:13.156867+0000","last_peered":"2024-03-19T06:38:13.156867+0000","last_clean":"2024-03-19T06:38:13.156867+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:38:13.156867+0000","last_undegraded":"2024-03-19T06:38:13.156867+0000","last_fullsized":"2024-03-19T06:38:13.156867+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'28","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173449+0000","last_change":"2024-03-19T06:06:34.586895+0000","last_active":"2024-03-19T06:38:37.173449+0000","last_peered":"2024-03-19T06:38:37.173449+0000","last_clean":"2024-03-19T06:38:37.173449+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:38:37.173449+0000","last_undegraded":"2024-03-19T06:38:37.173449+0000","last_fullsized":"2024-03-19T06:38:37.173449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'19","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.613144+0000","last_change":"2024-03-19T06:38:56.613232+0000","last_active":"2024-03-19T06:38:56.613144+0000","last_peered":"2024-03-19T06:38:56.613144+0000","last_clean":"2024-03-19T06:38:56.613144+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:38:56.613144+0000","last_undegraded":"2024-03-19T06:38:56.613144+0000","last_fullsized":"2024-03-19T06:38:56.613144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:56.612929+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:56.612929+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.612929+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:28:29.764669+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'50","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:58.154189+0000","last_change":"2024-03-19T06:06:42.446852+0000","last_active":"2024-03-19T06:37:58.154189+0000","last_peered":"2024-03-19T06:37:58.154189+0000","last_clean":"2024-03-19T06:37:58.154189+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:37:58.154189+0000","last_undegraded":"2024-03-19T06:37:58.154189+0000","last_fullsized":"2024-03-19T06:37:58.154189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.160659+0000","last_change":"2024-03-19T06:06:34.597241+0000","last_active":"2024-03-19T06:38:37.160659+0000","last_peered":"2024-03-19T06:38:37.160659+0000","last_clean":"2024-03-19T06:38:37.160659+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:38:37.160659+0000","last_undegraded":"2024-03-19T06:38:37.160659+0000","last_fullsized":"2024-03-19T06:38:37.160659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'1210","reported_seq":1258,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:30.332706+0000","last_change":"2024-03-19T06:06:33.106747+0000","last_active":"2024-03-19T06:38:30.332706+0000","last_peered":"2024-03-19T06:38:30.332706+0000","last_clean":"2024-03-19T06:38:30.332706+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:38:30.332706+0000","last_undegraded":"2024-03-19T06:38:30.332706+0000","last_fullsized":"2024-03-19T06:38:30.332706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":1210,"log_dups_size":0,"ondisk_log_size":1210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'85","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:48.104090+0000","last_change":"2024-03-19T06:07:02.246594+0000","last_active":"2024-03-19T06:38:48.104090+0000","last_peered":"2024-03-19T06:38:48.104090+0000","last_clean":"2024-03-19T06:38:48.104090+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:38:48.104090+0000","last_undegraded":"2024-03-19T06:38:48.104090+0000","last_fullsized":"2024-03-19T06:38:48.104090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":11129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'23","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.030170+0000","last_change":"2024-03-19T06:06:34.588150+0000","last_active":"2024-03-19T06:38:37.030170+0000","last_peered":"2024-03-19T06:38:37.030170+0000","last_clean":"2024-03-19T06:38:37.030170+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:38:37.030170+0000","last_undegraded":"2024-03-19T06:38:37.030170+0000","last_fullsized":"2024-03-19T06:38:37.030170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:11.780133+0000","last_change":"2024-03-19T06:06:33.100396+0000","last_active":"2024-03-19T06:38:11.780133+0000","last_peered":"2024-03-19T06:38:11.780133+0000","last_clean":"2024-03-19T06:38:11.780133+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:38:11.780133+0000","last_undegraded":"2024-03-19T06:38:11.780133+0000","last_fullsized":"2024-03-19T06:38:11.780133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'48","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:57.486394+0000","last_change":"2024-03-19T06:06:42.453190+0000","last_active":"2024-03-19T06:37:57.486394+0000","last_peered":"2024-03-19T06:37:57.486394+0000","last_clean":"2024-03-19T06:37:57.486394+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:37:57.486394+0000","last_undegraded":"2024-03-19T06:37:57.486394+0000","last_fullsized":"2024-03-19T06:37:57.486394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":5603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.345566+0000","last_change":"2024-03-19T06:38:55.345637+0000","last_active":"2024-03-19T06:38:55.345566+0000","last_peered":"2024-03-19T06:38:55.345566+0000","last_clean":"2024-03-19T06:38:55.345566+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:38:55.345566+0000","last_undegraded":"2024-03-19T06:38:55.345566+0000","last_fullsized":"2024-03-19T06:38:55.345566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-19T06:38:55.345363+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-19T06:38:55.345363+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.345363+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:32:33.484867+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.354368+0000","last_change":"2024-03-19T06:38:52.354432+0000","last_active":"2024-03-19T06:38:52.354368+0000","last_peered":"2024-03-19T06:38:52.354368+0000","last_clean":"2024-03-19T06:38:52.354368+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:38:52.354368+0000","last_undegraded":"2024-03-19T06:38:52.354368+0000","last_fullsized":"2024-03-19T06:38:52.354368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-19T06:38:52.354205+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-19T06:38:52.354205+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.354205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:43:05.945906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'69","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:57.293985+0000","last_change":"2024-03-19T06:06:42.170422+0000","last_active":"2024-03-19T06:37:57.293985+0000","last_peered":"2024-03-19T06:37:57.293985+0000","last_clean":"2024-03-19T06:37:57.293985+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:37:57.293985+0000","last_undegraded":"2024-03-19T06:37:57.293985+0000","last_fullsized":"2024-03-19T06:37:57.293985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'20","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.284947+0000","last_change":"2024-03-19T06:38:55.285009+0000","last_active":"2024-03-19T06:38:55.284947+0000","last_peered":"2024-03-19T06:38:55.284947+0000","last_clean":"2024-03-19T06:38:55.284947+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:38:55.284947+0000","last_undegraded":"2024-03-19T06:38:55.284947+0000","last_fullsized":"2024-03-19T06:38:55.284947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-19T06:38:55.284760+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-19T06:38:55.284760+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.284760+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:05.792627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'10","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:23.538145+0000","last_change":"2024-03-19T06:06:33.098378+0000","last_active":"2024-03-19T06:38:23.538145+0000","last_peered":"2024-03-19T06:38:23.538145+0000","last_clean":"2024-03-19T06:38:23.538145+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:38:23.538145+0000","last_undegraded":"2024-03-19T06:38:23.538145+0000","last_fullsized":"2024-03-19T06:38:23.538145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'57","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:57.294050+0000","last_change":"2024-03-19T06:06:42.163179+0000","last_active":"2024-03-19T06:37:57.294050+0000","last_peered":"2024-03-19T06:37:57.294050+0000","last_clean":"2024-03-19T06:37:57.294050+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:37:57.294050+0000","last_undegraded":"2024-03-19T06:37:57.294050+0000","last_fullsized":"2024-03-19T06:37:57.294050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'24","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:42.301200+0000","last_change":"2024-03-19T06:06:34.590688+0000","last_active":"2024-03-19T06:38:42.301200+0000","last_peered":"2024-03-19T06:38:42.301200+0000","last_clean":"2024-03-19T06:38:42.301200+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:38:42.301200+0000","last_undegraded":"2024-03-19T06:38:42.301200+0000","last_fullsized":"2024-03-19T06:38:42.301200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'500","reported_seq":1038,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.620321+0000","last_change":"2024-03-19T06:38:51.620352+0000","last_active":"2024-03-19T06:38:51.620321+0000","last_peered":"2024-03-19T06:38:51.620321+0000","last_clean":"2024-03-19T06:38:51.620321+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:38:51.620321+0000","last_undegraded":"2024-03-19T06:38:51.620321+0000","last_fullsized":"2024-03-19T06:38:51.620321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'500","last_scrub_stamp":"2024-03-19T06:38:51.620253+0000","last_deep_scrub":"32'500","last_deep_scrub_stamp":"2024-03-19T06:38:51.620253+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.620253+0000","objects_scrubbed":4,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:15.245756+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117202,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":494,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'60","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.623593+0000","last_change":"2024-03-19T06:06:42.174204+0000","last_active":"2024-03-19T06:37:19.623593+0000","last_peered":"2024-03-19T06:37:19.623593+0000","last_clean":"2024-03-19T06:37:19.623593+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:37:19.623593+0000","last_undegraded":"2024-03-19T06:37:19.623593+0000","last_fullsized":"2024-03-19T06:37:19.623593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'13","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.683814+0000","last_change":"2024-03-19T06:38:53.683873+0000","last_active":"2024-03-19T06:38:53.683814+0000","last_peered":"2024-03-19T06:38:53.683814+0000","last_clean":"2024-03-19T06:38:53.683814+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:38:53.683814+0000","last_undegraded":"2024-03-19T06:38:53.683814+0000","last_fullsized":"2024-03-19T06:38:53.683814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-03-19T06:38:53.683609+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-03-19T06:38:53.683609+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.683609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:51:36.217447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:38.139093+0000","last_change":"2024-03-19T06:06:33.099958+0000","last_active":"2024-03-19T06:38:38.139093+0000","last_peered":"2024-03-19T06:38:38.139093+0000","last_clean":"2024-03-19T06:38:38.139093+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:38:38.139093+0000","last_undegraded":"2024-03-19T06:38:38.139093+0000","last_fullsized":"2024-03-19T06:38:38.139093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'93","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.813975+0000","last_change":"2024-03-19T06:06:42.447131+0000","last_active":"2024-03-19T06:37:17.813975+0000","last_peered":"2024-03-19T06:37:17.813975+0000","last_clean":"2024-03-19T06:37:17.813975+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:37:17.813975+0000","last_undegraded":"2024-03-19T06:37:17.813975+0000","last_fullsized":"2024-03-19T06:37:17.813975+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'18","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.268888+0000","last_change":"2024-03-19T06:38:53.268920+0000","last_active":"2024-03-19T06:38:53.268888+0000","last_peered":"2024-03-19T06:38:53.268888+0000","last_clean":"2024-03-19T06:38:53.268888+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:38:53.268888+0000","last_undegraded":"2024-03-19T06:38:53.268888+0000","last_fullsized":"2024-03-19T06:38:53.268888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:53.268793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:53.268793+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.268793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:31.839053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.309101+0000","last_change":"2024-03-19T06:38:57.309175+0000","last_active":"2024-03-19T06:38:57.309101+0000","last_peered":"2024-03-19T06:38:57.309101+0000","last_clean":"2024-03-19T06:38:57.309101+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:38:57.309101+0000","last_undegraded":"2024-03-19T06:38:57.309101+0000","last_fullsized":"2024-03-19T06:38:57.309101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:38:57.308987+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:38:57.308987+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.308987+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:11.801467+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:18.135605+0000","last_change":"2024-03-19T06:06:10.120112+0000","last_active":"2024-03-19T06:38:18.135605+0000","last_peered":"2024-03-19T06:38:18.135605+0000","last_clean":"2024-03-19T06:38:18.135605+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:38:18.135605+0000","last_undegraded":"2024-03-19T06:38:18.135605+0000","last_fullsized":"2024-03-19T06:38:18.135605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:08.529771+0000","last_clean_scrub_stamp":"2024-03-19T06:06:08.529771+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'67","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:02.200315+0000","last_change":"2024-03-19T06:06:42.455329+0000","last_active":"2024-03-19T06:38:02.200315+0000","last_peered":"2024-03-19T06:38:02.200315+0000","last_clean":"2024-03-19T06:38:02.200315+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:38:02.200315+0000","last_undegraded":"2024-03-19T06:38:02.200315+0000","last_fullsized":"2024-03-19T06:38:02.200315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090075+0000","last_change":"2024-03-19T06:06:34.600070+0000","last_active":"2024-03-19T06:38:37.090075+0000","last_peered":"2024-03-19T06:38:37.090075+0000","last_clean":"2024-03-19T06:38:37.090075+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:38:37.090075+0000","last_undegraded":"2024-03-19T06:38:37.090075+0000","last_fullsized":"2024-03-19T06:38:37.090075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'12","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.537334+0000","last_change":"2024-03-19T06:38:54.537404+0000","last_active":"2024-03-19T06:38:54.537334+0000","last_peered":"2024-03-19T06:38:54.537334+0000","last_clean":"2024-03-19T06:38:54.537334+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:38:54.537334+0000","last_undegraded":"2024-03-19T06:38:54.537334+0000","last_fullsized":"2024-03-19T06:38:54.537334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-19T06:38:54.537171+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-19T06:38:54.537171+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.537171+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:04:29.895117+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'77","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.583008+0000","last_change":"2024-03-19T06:06:42.448679+0000","last_active":"2024-03-19T06:37:18.583008+0000","last_peered":"2024-03-19T06:37:18.583008+0000","last_clean":"2024-03-19T06:37:18.583008+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:37:18.583008+0000","last_undegraded":"2024-03-19T06:37:18.583008+0000","last_fullsized":"2024-03-19T06:37:18.583008+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"32'20","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.035316+0000","last_change":"2024-03-19T06:06:34.535611+0000","last_active":"2024-03-19T06:38:37.035316+0000","last_peered":"2024-03-19T06:38:37.035316+0000","last_clean":"2024-03-19T06:38:37.035316+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:38:37.035316+0000","last_undegraded":"2024-03-19T06:38:37.035316+0000","last_fullsized":"2024-03-19T06:38:37.035316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.356877+0000","last_change":"2024-03-19T06:38:54.356918+0000","last_active":"2024-03-19T06:38:54.356877+0000","last_peered":"2024-03-19T06:38:54.356877+0000","last_clean":"2024-03-19T06:38:54.356877+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:38:54.356877+0000","last_undegraded":"2024-03-19T06:38:54.356877+0000","last_fullsized":"2024-03-19T06:38:54.356877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:38:54.356768+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:38:54.356768+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.356768+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:15:21.672961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'101","reported_seq":137,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:12.489201+0000","last_change":"2024-03-19T06:06:42.171436+0000","last_active":"2024-03-19T06:38:12.489201+0000","last_peered":"2024-03-19T06:38:12.489201+0000","last_clean":"2024-03-19T06:38:12.489201+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:38:12.489201+0000","last_undegraded":"2024-03-19T06:38:12.489201+0000","last_fullsized":"2024-03-19T06:38:12.489201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":8077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'23","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090217+0000","last_change":"2024-03-19T06:06:34.599183+0000","last_active":"2024-03-19T06:38:37.090217+0000","last_peered":"2024-03-19T06:38:37.090217+0000","last_clean":"2024-03-19T06:38:37.090217+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:38:37.090217+0000","last_undegraded":"2024-03-19T06:38:37.090217+0000","last_fullsized":"2024-03-19T06:38:37.090217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.572119+0000","last_change":"2024-03-19T06:38:53.572167+0000","last_active":"2024-03-19T06:38:53.572119+0000","last_peered":"2024-03-19T06:38:53.572119+0000","last_clean":"2024-03-19T06:38:53.572119+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:38:53.572119+0000","last_undegraded":"2024-03-19T06:38:53.572119+0000","last_fullsized":"2024-03-19T06:38:53.572119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-19T06:38:53.572012+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-19T06:38:53.572012+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.572012+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:06.654175+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'66","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:12.929549+0000","last_change":"2024-03-19T06:06:42.450813+0000","last_active":"2024-03-19T06:37:12.929549+0000","last_peered":"2024-03-19T06:37:12.929549+0000","last_clean":"2024-03-19T06:37:12.929549+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:37:12.929549+0000","last_undegraded":"2024-03-19T06:37:12.929549+0000","last_fullsized":"2024-03-19T06:37:12.929549+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'16","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.088356+0000","last_change":"2024-03-19T06:06:34.598848+0000","last_active":"2024-03-19T06:38:37.088356+0000","last_peered":"2024-03-19T06:38:37.088356+0000","last_clean":"2024-03-19T06:38:37.088356+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:38:37.088356+0000","last_undegraded":"2024-03-19T06:38:37.088356+0000","last_fullsized":"2024-03-19T06:38:37.088356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.322366+0000","last_change":"2024-03-19T06:38:54.322493+0000","last_active":"2024-03-19T06:38:54.322366+0000","last_peered":"2024-03-19T06:38:54.322366+0000","last_clean":"2024-03-19T06:38:54.322366+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:38:54.322366+0000","last_undegraded":"2024-03-19T06:38:54.322366+0000","last_fullsized":"2024-03-19T06:38:54.322366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-19T06:38:54.322166+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-19T06:38:54.322166+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.322166+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:20:18.862934+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'94","reported_seq":130,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.510282+0000","last_change":"2024-03-19T06:06:42.163902+0000","last_active":"2024-03-19T06:37:18.510282+0000","last_peered":"2024-03-19T06:37:18.510282+0000","last_clean":"2024-03-19T06:37:18.510282+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:37:18.510282+0000","last_undegraded":"2024-03-19T06:37:18.510282+0000","last_fullsized":"2024-03-19T06:37:18.510282+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'23","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090136+0000","last_change":"2024-03-19T06:06:34.593601+0000","last_active":"2024-03-19T06:38:37.090136+0000","last_peered":"2024-03-19T06:38:37.090136+0000","last_clean":"2024-03-19T06:38:37.090136+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:38:37.090136+0000","last_undegraded":"2024-03-19T06:38:37.090136+0000","last_fullsized":"2024-03-19T06:38:37.090136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'27","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.622082+0000","last_change":"2024-03-19T06:38:52.622172+0000","last_active":"2024-03-19T06:38:52.622082+0000","last_peered":"2024-03-19T06:38:52.622082+0000","last_clean":"2024-03-19T06:38:52.622082+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:38:52.622082+0000","last_undegraded":"2024-03-19T06:38:52.622082+0000","last_fullsized":"2024-03-19T06:38:52.622082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:38:52.621881+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:38:52.621881+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.621881+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:36:16.570622+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'78","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:07.488134+0000","last_change":"2024-03-19T06:06:42.175927+0000","last_active":"2024-03-19T06:38:07.488134+0000","last_peered":"2024-03-19T06:38:07.488134+0000","last_clean":"2024-03-19T06:38:07.488134+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:38:07.488134+0000","last_undegraded":"2024-03-19T06:38:07.488134+0000","last_fullsized":"2024-03-19T06:38:07.488134+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.255418+0000","last_change":"2024-03-19T06:06:34.331672+0000","last_active":"2024-03-19T06:38:37.255418+0000","last_peered":"2024-03-19T06:38:37.255418+0000","last_clean":"2024-03-19T06:38:37.255418+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:38:37.255418+0000","last_undegraded":"2024-03-19T06:38:37.255418+0000","last_fullsized":"2024-03-19T06:38:37.255418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'7","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.667379+0000","last_change":"2024-03-19T06:06:33.110595+0000","last_active":"2024-03-19T06:38:36.667379+0000","last_peered":"2024-03-19T06:38:36.667379+0000","last_clean":"2024-03-19T06:38:36.667379+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:38:36.667379+0000","last_undegraded":"2024-03-19T06:38:36.667379+0000","last_fullsized":"2024-03-19T06:38:36.667379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'70","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:08.098355+0000","last_change":"2024-03-19T06:06:42.446061+0000","last_active":"2024-03-19T06:38:08.098355+0000","last_peered":"2024-03-19T06:38:08.098355+0000","last_clean":"2024-03-19T06:38:08.098355+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:38:08.098355+0000","last_undegraded":"2024-03-19T06:38:08.098355+0000","last_fullsized":"2024-03-19T06:38:08.098355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090240+0000","last_change":"2024-03-19T06:06:34.594677+0000","last_active":"2024-03-19T06:38:37.090240+0000","last_peered":"2024-03-19T06:38:37.090240+0000","last_clean":"2024-03-19T06:38:37.090240+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:38:37.090240+0000","last_undegraded":"2024-03-19T06:38:37.090240+0000","last_fullsized":"2024-03-19T06:38:37.090240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'11","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.326833+0000","last_change":"2024-03-19T06:38:56.326909+0000","last_active":"2024-03-19T06:38:56.326833+0000","last_peered":"2024-03-19T06:38:56.326833+0000","last_clean":"2024-03-19T06:38:56.326833+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:38:56.326833+0000","last_undegraded":"2024-03-19T06:38:56.326833+0000","last_fullsized":"2024-03-19T06:38:56.326833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-03-19T06:38:56.326649+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-03-19T06:38:56.326649+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.326649+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:05:14.434532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:08.087742+0000","last_change":"2024-03-19T06:07:02.251618+0000","last_active":"2024-03-19T06:37:08.087742+0000","last_peered":"2024-03-19T06:37:08.087742+0000","last_clean":"2024-03-19T06:37:08.087742+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:37:08.087742+0000","last_undegraded":"2024-03-19T06:37:08.087742+0000","last_fullsized":"2024-03-19T06:37:08.087742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.171019+0000","last_change":"2024-03-19T06:06:34.597129+0000","last_active":"2024-03-19T06:38:37.171019+0000","last_peered":"2024-03-19T06:38:37.171019+0000","last_clean":"2024-03-19T06:38:37.171019+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:38:37.171019+0000","last_undegraded":"2024-03-19T06:38:37.171019+0000","last_fullsized":"2024-03-19T06:38:37.171019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'16","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:50.702943+0000","last_change":"2024-03-19T06:38:50.703020+0000","last_active":"2024-03-19T06:38:50.702943+0000","last_peered":"2024-03-19T06:38:50.702943+0000","last_clean":"2024-03-19T06:38:50.702943+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:38:50.702943+0000","last_undegraded":"2024-03-19T06:38:50.702943+0000","last_fullsized":"2024-03-19T06:38:50.702943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:38:50.702746+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:38:50.702746+0000","last_clean_scrub_stamp":"2024-03-19T06:38:50.702746+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:33:29.544944+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'61","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:08.110478+0000","last_change":"2024-03-19T06:06:42.447757+0000","last_active":"2024-03-19T06:38:08.110478+0000","last_peered":"2024-03-19T06:38:08.110478+0000","last_clean":"2024-03-19T06:38:08.110478+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:38:08.110478+0000","last_undegraded":"2024-03-19T06:38:08.110478+0000","last_fullsized":"2024-03-19T06:38:08.110478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'18","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032122+0000","last_change":"2024-03-19T06:06:34.598698+0000","last_active":"2024-03-19T06:38:37.032122+0000","last_peered":"2024-03-19T06:38:37.032122+0000","last_clean":"2024-03-19T06:38:37.032122+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:38:37.032122+0000","last_undegraded":"2024-03-19T06:38:37.032122+0000","last_fullsized":"2024-03-19T06:38:37.032122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'840","reported_seq":887,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:28.716323+0000","last_change":"2024-03-19T06:06:33.111068+0000","last_active":"2024-03-19T06:38:28.716323+0000","last_peered":"2024-03-19T06:38:28.716323+0000","last_clean":"2024-03-19T06:38:28.716323+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:38:28.716323+0000","last_undegraded":"2024-03-19T06:38:28.716323+0000","last_fullsized":"2024-03-19T06:38:28.716323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":840,"log_dups_size":0,"ondisk_log_size":840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'84","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.682886+0000","last_change":"2024-03-19T06:06:42.175083+0000","last_active":"2024-03-19T06:37:19.682886+0000","last_peered":"2024-03-19T06:37:19.682886+0000","last_clean":"2024-03-19T06:37:19.682886+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:37:19.682886+0000","last_undegraded":"2024-03-19T06:37:19.682886+0000","last_fullsized":"2024-03-19T06:37:19.682886+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":13735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'24","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.037790+0000","last_change":"2024-03-19T06:06:34.591889+0000","last_active":"2024-03-19T06:38:37.037790+0000","last_peered":"2024-03-19T06:38:37.037790+0000","last_clean":"2024-03-19T06:38:37.037790+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:38:37.037790+0000","last_undegraded":"2024-03-19T06:38:37.037790+0000","last_fullsized":"2024-03-19T06:38:37.037790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'336","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.311517+0000","last_change":"2024-03-19T06:38:55.311566+0000","last_active":"2024-03-19T06:38:55.311517+0000","last_peered":"2024-03-19T06:38:55.311517+0000","last_clean":"2024-03-19T06:38:55.311517+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:38:55.311517+0000","last_undegraded":"2024-03-19T06:38:55.311517+0000","last_fullsized":"2024-03-19T06:38:55.311517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'336","last_scrub_stamp":"2024-03-19T06:38:55.311416+0000","last_deep_scrub":"32'336","last_deep_scrub_stamp":"2024-03-19T06:38:55.311416+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.311416+0000","objects_scrubbed":4,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:27:41.513032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'115","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.007383+0000","last_change":"2024-03-19T06:06:42.161721+0000","last_active":"2024-03-19T06:37:17.007383+0000","last_peered":"2024-03-19T06:37:17.007383+0000","last_clean":"2024-03-19T06:37:17.007383+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:37:17.007383+0000","last_undegraded":"2024-03-19T06:37:17.007383+0000","last_fullsized":"2024-03-19T06:37:17.007383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":11739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'25","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.172963+0000","last_change":"2024-03-19T06:06:34.543129+0000","last_active":"2024-03-19T06:38:37.172963+0000","last_peered":"2024-03-19T06:38:37.172963+0000","last_clean":"2024-03-19T06:38:37.172963+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:38:37.172963+0000","last_undegraded":"2024-03-19T06:38:37.172963+0000","last_fullsized":"2024-03-19T06:38:37.172963+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'7","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:24.518409+0000","last_change":"2024-03-19T06:06:33.105273+0000","last_active":"2024-03-19T06:38:24.518409+0000","last_peered":"2024-03-19T06:38:24.518409+0000","last_clean":"2024-03-19T06:38:24.518409+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:38:24.518409+0000","last_undegraded":"2024-03-19T06:38:24.518409+0000","last_fullsized":"2024-03-19T06:38:24.518409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'77","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:10.120734+0000","last_change":"2024-03-19T06:06:42.164967+0000","last_active":"2024-03-19T06:37:10.120734+0000","last_peered":"2024-03-19T06:37:10.120734+0000","last_clean":"2024-03-19T06:37:10.120734+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:37:10.120734+0000","last_undegraded":"2024-03-19T06:37:10.120734+0000","last_fullsized":"2024-03-19T06:37:10.120734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.063428+0000","last_change":"2024-03-19T06:06:34.591277+0000","last_active":"2024-03-19T06:38:37.063428+0000","last_peered":"2024-03-19T06:38:37.063428+0000","last_clean":"2024-03-19T06:38:37.063428+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:38:37.063428+0000","last_undegraded":"2024-03-19T06:38:37.063428+0000","last_fullsized":"2024-03-19T06:38:37.063428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.665388+0000","last_change":"2024-03-19T06:06:33.108763+0000","last_active":"2024-03-19T06:38:36.665388+0000","last_peered":"2024-03-19T06:38:36.665388+0000","last_clean":"2024-03-19T06:38:36.665388+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:38:36.665388+0000","last_undegraded":"2024-03-19T06:38:36.665388+0000","last_fullsized":"2024-03-19T06:38:36.665388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'86","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:19.612037+0000","last_change":"2024-03-19T06:06:42.455351+0000","last_active":"2024-03-19T06:37:19.612037+0000","last_peered":"2024-03-19T06:37:19.612037+0000","last_clean":"2024-03-19T06:37:19.612037+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:37:19.612037+0000","last_undegraded":"2024-03-19T06:37:19.612037+0000","last_fullsized":"2024-03-19T06:37:19.612037+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":9535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'52","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:47.495887+0000","last_change":"2024-03-19T06:06:42.450427+0000","last_active":"2024-03-19T06:38:47.495887+0000","last_peered":"2024-03-19T06:38:47.495887+0000","last_clean":"2024-03-19T06:38:47.495887+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:38:47.495887+0000","last_undegraded":"2024-03-19T06:38:47.495887+0000","last_fullsized":"2024-03-19T06:38:47.495887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'27","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032126+0000","last_change":"2024-03-19T06:06:34.583960+0000","last_active":"2024-03-19T06:38:37.032126+0000","last_peered":"2024-03-19T06:38:37.032126+0000","last_clean":"2024-03-19T06:38:37.032126+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:38:37.032126+0000","last_undegraded":"2024-03-19T06:38:37.032126+0000","last_fullsized":"2024-03-19T06:38:37.032126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'9","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:16.136813+0000","last_change":"2024-03-19T06:06:33.097392+0000","last_active":"2024-03-19T06:38:16.136813+0000","last_peered":"2024-03-19T06:38:16.136813+0000","last_clean":"2024-03-19T06:38:16.136813+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:38:16.136813+0000","last_undegraded":"2024-03-19T06:38:16.136813+0000","last_fullsized":"2024-03-19T06:38:16.136813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'66","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:57.199410+0000","last_change":"2024-03-19T06:06:42.173173+0000","last_active":"2024-03-19T06:37:57.199410+0000","last_peered":"2024-03-19T06:37:57.199410+0000","last_clean":"2024-03-19T06:37:57.199410+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:37:57.199410+0000","last_undegraded":"2024-03-19T06:37:57.199410+0000","last_fullsized":"2024-03-19T06:37:57.199410+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'26","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.173888+0000","last_change":"2024-03-19T06:06:34.318967+0000","last_active":"2024-03-19T06:38:37.173888+0000","last_peered":"2024-03-19T06:38:37.173888+0000","last_clean":"2024-03-19T06:38:37.173888+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:38:37.173888+0000","last_undegraded":"2024-03-19T06:38:37.173888+0000","last_fullsized":"2024-03-19T06:38:37.173888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:03.097371+0000","last_change":"2024-03-19T06:06:33.107034+0000","last_active":"2024-03-19T06:38:03.097371+0000","last_peered":"2024-03-19T06:38:03.097371+0000","last_clean":"2024-03-19T06:38:03.097371+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:38:03.097371+0000","last_undegraded":"2024-03-19T06:38:03.097371+0000","last_fullsized":"2024-03-19T06:38:03.097371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'429","reported_seq":475,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:59.093156+0000","last_change":"2024-03-19T06:06:33.111722+0000","last_active":"2024-03-19T06:37:59.093156+0000","last_peered":"2024-03-19T06:37:59.093156+0000","last_clean":"2024-03-19T06:37:59.093156+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:37:59.093156+0000","last_undegraded":"2024-03-19T06:37:59.093156+0000","last_fullsized":"2024-03-19T06:37:59.093156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'23","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.639103+0000","last_change":"2024-03-19T06:38:54.639127+0000","last_active":"2024-03-19T06:38:54.639103+0000","last_peered":"2024-03-19T06:38:54.639103+0000","last_clean":"2024-03-19T06:38:54.639103+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:38:54.639103+0000","last_undegraded":"2024-03-19T06:38:54.639103+0000","last_fullsized":"2024-03-19T06:38:54.639103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:38:54.639016+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:38:54.639016+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.639016+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:07.001544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'57","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:18.510817+0000","last_change":"2024-03-19T06:06:42.147197+0000","last_active":"2024-03-19T06:37:18.510817+0000","last_peered":"2024-03-19T06:37:18.510817+0000","last_clean":"2024-03-19T06:37:18.510817+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:37:18.510817+0000","last_undegraded":"2024-03-19T06:37:18.510817+0000","last_fullsized":"2024-03-19T06:37:18.510817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'545","reported_seq":591,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:36.665305+0000","last_change":"2024-03-19T06:06:33.097393+0000","last_active":"2024-03-19T06:38:36.665305+0000","last_peered":"2024-03-19T06:38:36.665305+0000","last_clean":"2024-03-19T06:38:36.665305+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:38:36.665305+0000","last_undegraded":"2024-03-19T06:38:36.665305+0000","last_fullsized":"2024-03-19T06:38:36.665305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:31.208400+0000","last_clean_scrub_stamp":"2024-03-19T06:06:31.208400+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.036723+0000","last_change":"2024-03-19T06:06:34.593022+0000","last_active":"2024-03-19T06:38:37.036723+0000","last_peered":"2024-03-19T06:38:37.036723+0000","last_clean":"2024-03-19T06:38:37.036723+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:38:37.036723+0000","last_undegraded":"2024-03-19T06:38:37.036723+0000","last_fullsized":"2024-03-19T06:38:37.036723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'76","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:37:17.099078+0000","last_change":"2024-03-19T06:06:42.106612+0000","last_active":"2024-03-19T06:37:17.099078+0000","last_peered":"2024-03-19T06:37:17.099078+0000","last_clean":"2024-03-19T06:37:17.099078+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:37:17.099078+0000","last_undegraded":"2024-03-19T06:37:17.099078+0000","last_fullsized":"2024-03-19T06:37:17.099078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:40.761289+0000","last_clean_scrub_stamp":"2024-03-19T06:06:40.761289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'30","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.268343+0000","last_change":"2024-03-19T06:06:34.330932+0000","last_active":"2024-03-19T06:38:37.268343+0000","last_peered":"2024-03-19T06:38:37.268343+0000","last_clean":"2024-03-19T06:38:37.268343+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:38:37.268343+0000","last_undegraded":"2024-03-19T06:38:37.268343+0000","last_fullsized":"2024-03-19T06:38:37.268343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'25","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.520037+0000","last_change":"2024-03-19T06:38:56.520168+0000","last_active":"2024-03-19T06:38:56.520037+0000","last_peered":"2024-03-19T06:38:56.520037+0000","last_clean":"2024-03-19T06:38:56.520037+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:38:56.520037+0000","last_undegraded":"2024-03-19T06:38:56.520037+0000","last_fullsized":"2024-03-19T06:38:56.520037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-03-19T06:38:56.519673+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-03-19T06:38:56.519673+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.519673+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:08:36.026663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'25","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116302+0000","last_change":"2024-03-19T06:07:02.003744+0000","last_active":"2024-03-19T06:38:37.116302+0000","last_peered":"2024-03-19T06:38:37.116302+0000","last_clean":"2024-03-19T06:38:37.116302+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:38:37.116302+0000","last_undegraded":"2024-03-19T06:38:37.116302+0000","last_fullsized":"2024-03-19T06:38:37.116302+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'18","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.712355+0000","last_change":"2024-03-19T06:38:52.712393+0000","last_active":"2024-03-19T06:38:52.712355+0000","last_peered":"2024-03-19T06:38:52.712355+0000","last_clean":"2024-03-19T06:38:52.712355+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:38:52.712355+0000","last_undegraded":"2024-03-19T06:38:52.712355+0000","last_fullsized":"2024-03-19T06:38:52.712355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:52.712243+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:52.712243+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.712243+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:02:51.210372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'17","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.159960+0000","last_change":"2024-03-19T06:06:34.341646+0000","last_active":"2024-03-19T06:38:37.159960+0000","last_peered":"2024-03-19T06:38:37.159960+0000","last_clean":"2024-03-19T06:38:37.159960+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:38:37.159960+0000","last_undegraded":"2024-03-19T06:38:37.159960+0000","last_fullsized":"2024-03-19T06:38:37.159960+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'19","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:50.334451+0000","last_change":"2024-03-19T06:38:50.334479+0000","last_active":"2024-03-19T06:38:50.334451+0000","last_peered":"2024-03-19T06:38:50.334451+0000","last_clean":"2024-03-19T06:38:50.334451+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:38:50.334451+0000","last_undegraded":"2024-03-19T06:38:50.334451+0000","last_fullsized":"2024-03-19T06:38:50.334451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:50.334362+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:50.334362+0000","last_clean_scrub_stamp":"2024-03-19T06:38:50.334362+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:33:29.176560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.269582+0000","last_change":"2024-03-19T06:06:34.589257+0000","last_active":"2024-03-19T06:38:37.269582+0000","last_peered":"2024-03-19T06:38:37.269582+0000","last_clean":"2024-03-19T06:38:37.269582+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:38:37.269582+0000","last_undegraded":"2024-03-19T06:38:37.269582+0000","last_fullsized":"2024-03-19T06:38:37.269582+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'15","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.263915+0000","last_change":"2024-03-19T06:38:56.263975+0000","last_active":"2024-03-19T06:38:56.263915+0000","last_peered":"2024-03-19T06:38:56.263915+0000","last_clean":"2024-03-19T06:38:56.263915+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:38:56.263915+0000","last_undegraded":"2024-03-19T06:38:56.263915+0000","last_fullsized":"2024-03-19T06:38:56.263915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-19T06:38:56.263715+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-19T06:38:56.263715+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.263715+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:39:23.570450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.029988+0000","last_change":"2024-03-19T06:06:34.540961+0000","last_active":"2024-03-19T06:38:37.029988+0000","last_peered":"2024-03-19T06:38:37.029988+0000","last_clean":"2024-03-19T06:38:37.029988+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:38:37.029988+0000","last_undegraded":"2024-03-19T06:38:37.029988+0000","last_fullsized":"2024-03-19T06:38:37.029988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.157912+0000","last_change":"2024-03-19T06:06:34.342039+0000","last_active":"2024-03-19T06:38:37.157912+0000","last_peered":"2024-03-19T06:38:37.157912+0000","last_clean":"2024-03-19T06:38:37.157912+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:38:37.157912+0000","last_undegraded":"2024-03-19T06:38:37.157912+0000","last_fullsized":"2024-03-19T06:38:37.157912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'24","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085537+0000","last_change":"2024-03-19T06:06:34.598468+0000","last_active":"2024-03-19T06:38:37.085537+0000","last_peered":"2024-03-19T06:38:37.085537+0000","last_clean":"2024-03-19T06:38:37.085537+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:38:37.085537+0000","last_undegraded":"2024-03-19T06:38:37.085537+0000","last_fullsized":"2024-03-19T06:38:37.085537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'30","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.174621+0000","last_change":"2024-03-19T06:06:34.591606+0000","last_active":"2024-03-19T06:38:37.174621+0000","last_peered":"2024-03-19T06:38:37.174621+0000","last_clean":"2024-03-19T06:38:37.174621+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:38:37.174621+0000","last_undegraded":"2024-03-19T06:38:37.174621+0000","last_fullsized":"2024-03-19T06:38:37.174621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'27","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.267398+0000","last_change":"2024-03-19T06:06:34.346596+0000","last_active":"2024-03-19T06:38:37.267398+0000","last_peered":"2024-03-19T06:38:37.267398+0000","last_clean":"2024-03-19T06:38:37.267398+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:38:37.267398+0000","last_undegraded":"2024-03-19T06:38:37.267398+0000","last_fullsized":"2024-03-19T06:38:37.267398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'22","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.087357+0000","last_change":"2024-03-19T06:06:34.595313+0000","last_active":"2024-03-19T06:38:37.087357+0000","last_peered":"2024-03-19T06:38:37.087357+0000","last_clean":"2024-03-19T06:38:37.087357+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:38:37.087357+0000","last_undegraded":"2024-03-19T06:38:37.087357+0000","last_fullsized":"2024-03-19T06:38:37.087357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'32","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.558526+0000","last_change":"2024-03-19T06:38:55.558589+0000","last_active":"2024-03-19T06:38:55.558526+0000","last_peered":"2024-03-19T06:38:55.558526+0000","last_clean":"2024-03-19T06:38:55.558526+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:38:55.558526+0000","last_undegraded":"2024-03-19T06:38:55.558526+0000","last_fullsized":"2024-03-19T06:38:55.558526+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-03-19T06:38:55.558372+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-03-19T06:38:55.558372+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.558372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:05.219255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.022870+0000","last_change":"2024-03-19T06:06:34.599568+0000","last_active":"2024-03-19T06:38:37.022870+0000","last_peered":"2024-03-19T06:38:37.022870+0000","last_clean":"2024-03-19T06:38:37.022870+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:38:37.022870+0000","last_undegraded":"2024-03-19T06:38:37.022870+0000","last_fullsized":"2024-03-19T06:38:37.022870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'26","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.085546+0000","last_change":"2024-03-19T06:06:34.545023+0000","last_active":"2024-03-19T06:38:37.085546+0000","last_peered":"2024-03-19T06:38:37.085546+0000","last_clean":"2024-03-19T06:38:37.085546+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:38:37.085546+0000","last_undegraded":"2024-03-19T06:38:37.085546+0000","last_fullsized":"2024-03-19T06:38:37.085546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'28","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.033092+0000","last_change":"2024-03-19T06:06:34.584899+0000","last_active":"2024-03-19T06:38:37.033092+0000","last_peered":"2024-03-19T06:38:37.033092+0000","last_clean":"2024-03-19T06:38:37.033092+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:38:37.033092+0000","last_undegraded":"2024-03-19T06:38:37.033092+0000","last_fullsized":"2024-03-19T06:38:37.033092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:49.711466+0000","last_change":"2024-03-19T06:38:49.711526+0000","last_active":"2024-03-19T06:38:49.711466+0000","last_peered":"2024-03-19T06:38:49.711466+0000","last_clean":"2024-03-19T06:38:49.711466+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:38:49.711466+0000","last_undegraded":"2024-03-19T06:38:49.711466+0000","last_fullsized":"2024-03-19T06:38:49.711466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-03-19T06:38:49.711300+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-03-19T06:38:49.711300+0000","last_clean_scrub_stamp":"2024-03-19T06:38:49.711300+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:36:04.928016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'33","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032571+0000","last_change":"2024-03-19T06:07:02.158646+0000","last_active":"2024-03-19T06:38:37.032571+0000","last_peered":"2024-03-19T06:38:37.032571+0000","last_clean":"2024-03-19T06:38:37.032571+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:38:37.032571+0000","last_undegraded":"2024-03-19T06:38:37.032571+0000","last_fullsized":"2024-03-19T06:38:37.032571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.315809+0000","last_change":"2024-03-19T06:38:56.315868+0000","last_active":"2024-03-19T06:38:56.315809+0000","last_peered":"2024-03-19T06:38:56.315809+0000","last_clean":"2024-03-19T06:38:56.315809+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:38:56.315809+0000","last_undegraded":"2024-03-19T06:38:56.315809+0000","last_fullsized":"2024-03-19T06:38:56.315809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:38:56.315634+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:38:56.315634+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.315634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:56:19.073701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'22","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.262644+0000","last_change":"2024-03-19T06:06:34.539185+0000","last_active":"2024-03-19T06:38:37.262644+0000","last_peered":"2024-03-19T06:38:37.262644+0000","last_clean":"2024-03-19T06:38:37.262644+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:38:37.262644+0000","last_undegraded":"2024-03-19T06:38:37.262644+0000","last_fullsized":"2024-03-19T06:38:37.262644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.270094+0000","last_change":"2024-03-19T06:06:34.543750+0000","last_active":"2024-03-19T06:38:37.270094+0000","last_peered":"2024-03-19T06:38:37.270094+0000","last_clean":"2024-03-19T06:38:37.270094+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:38:37.270094+0000","last_undegraded":"2024-03-19T06:38:37.270094+0000","last_fullsized":"2024-03-19T06:38:37.270094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'28","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090069+0000","last_change":"2024-03-19T06:06:34.597523+0000","last_active":"2024-03-19T06:38:37.090069+0000","last_peered":"2024-03-19T06:38:37.090069+0000","last_clean":"2024-03-19T06:38:37.090069+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:38:37.090069+0000","last_undegraded":"2024-03-19T06:38:37.090069+0000","last_fullsized":"2024-03-19T06:38:37.090069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.304257+0000","last_change":"2024-03-19T06:38:54.304279+0000","last_active":"2024-03-19T06:38:54.304257+0000","last_peered":"2024-03-19T06:38:54.304257+0000","last_clean":"2024-03-19T06:38:54.304257+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:38:54.304257+0000","last_undegraded":"2024-03-19T06:38:54.304257+0000","last_fullsized":"2024-03-19T06:38:54.304257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:54.304181+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:54.304181+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.304181+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:41:49.703236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'17","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.032235+0000","last_change":"2024-03-19T06:06:34.596506+0000","last_active":"2024-03-19T06:38:37.032235+0000","last_peered":"2024-03-19T06:38:37.032235+0000","last_clean":"2024-03-19T06:38:37.032235+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:38:37.032235+0000","last_undegraded":"2024-03-19T06:38:37.032235+0000","last_fullsized":"2024-03-19T06:38:37.032235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116522+0000","last_change":"2024-03-19T06:07:02.045592+0000","last_active":"2024-03-19T06:38:37.116522+0000","last_peered":"2024-03-19T06:38:37.116522+0000","last_clean":"2024-03-19T06:38:37.116522+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:38:37.116522+0000","last_undegraded":"2024-03-19T06:38:37.116522+0000","last_fullsized":"2024-03-19T06:38:37.116522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'22","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.090060+0000","last_change":"2024-03-19T06:06:34.592092+0000","last_active":"2024-03-19T06:38:37.090060+0000","last_peered":"2024-03-19T06:38:37.090060+0000","last_clean":"2024-03-19T06:38:37.090060+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:38:37.090060+0000","last_undegraded":"2024-03-19T06:38:37.090060+0000","last_fullsized":"2024-03-19T06:38:37.090060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:43.116514+0000","last_change":"2024-03-19T06:06:34.539750+0000","last_active":"2024-03-19T06:38:43.116514+0000","last_peered":"2024-03-19T06:38:43.116514+0000","last_clean":"2024-03-19T06:38:43.116514+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:38:43.116514+0000","last_undegraded":"2024-03-19T06:38:43.116514+0000","last_fullsized":"2024-03-19T06:38:43.116514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'24","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.658421+0000","last_change":"2024-03-19T06:38:55.658482+0000","last_active":"2024-03-19T06:38:55.658421+0000","last_peered":"2024-03-19T06:38:55.658421+0000","last_clean":"2024-03-19T06:38:55.658421+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:38:55.658421+0000","last_undegraded":"2024-03-19T06:38:55.658421+0000","last_fullsized":"2024-03-19T06:38:55.658421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-03-19T06:38:55.658241+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-03-19T06:38:55.658241+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.658241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:27:41.859857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.339175+0000","last_change":"2024-03-19T06:38:51.339286+0000","last_active":"2024-03-19T06:38:51.339175+0000","last_peered":"2024-03-19T06:38:51.339175+0000","last_clean":"2024-03-19T06:38:51.339175+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:38:51.339175+0000","last_undegraded":"2024-03-19T06:38:51.339175+0000","last_fullsized":"2024-03-19T06:38:51.339175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:51.338867+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:51.338867+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.338867+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:50:56.786904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'19","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:37.116528+0000","last_change":"2024-03-19T06:07:02.158695+0000","last_active":"2024-03-19T06:38:37.116528+0000","last_peered":"2024-03-19T06:38:37.116528+0000","last_clean":"2024-03-19T06:38:37.116528+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:38:37.116528+0000","last_undegraded":"2024-03-19T06:38:37.116528+0000","last_fullsized":"2024-03-19T06:38:37.116528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-19T06:06:32.479612+0000","last_clean_scrub_stamp":"2024-03-19T06:06:32.479612+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2145,"num_write_kb":250125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2307,"ondisk_log_size":2307,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1476,"ondisk_log_size":1476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22012001,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":7122,"num_write_kb":24983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44269568,"data_stored":44024002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5554,"ondisk_log_size":5554,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477136,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":13553664,"data_stored":13317561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719477135,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39876,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331964,"statfs":{"total":96636764160,"available":96595931136,"internally_reserved":0,"allocated":389120,"data_stored":146113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477134,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":8753152,"data_stored":8532119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477134,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":9564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":9793536,"data_stored":9563926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509838,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39724,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332116,"statfs":{"total":96636764160,"available":96596086784,"internally_reserved":0,"allocated":8753152,"data_stored":8532251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509838,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":260733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509838,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":143131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509838,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":5932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":6074368,"data_stored":5841696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5140480,"data_stored":5109729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":119134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9422327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:38:58.707 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.707 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.707 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.707 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.708 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.709 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.710 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-19T06:06:08.529771+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=8, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.711 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.712 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.713 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.714 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.715 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-19T06:06:31.208400+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=31, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-19T06:06:40.761289+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=40, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.716 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.717 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.718 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.719 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.719 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.719 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-19T06:06:32.479612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=6, tm_sec=32, tm_wday=1, tm_yday=79, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=19, tm_hour=6, tm_min=38, tm_sec=46, tm_wday=1, tm_yday=79, tm_isdst=0) 2024-03-19T06:38:58.719 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-19T06:39:18.720 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-19T06:39:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.969+0000 7f9955a00640 1 Processor -- start 2024-03-19T06:39:18.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.969+0000 7f9955a00640 1 -- start start 2024-03-19T06:39:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.971+0000 7f9955a00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9950151f70 0x7f99500c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.971+0000 7f9955a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99500c1e60 0x7f995006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.971+0000 7f9955a00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500c27c0 con 0x7f995015b1d0 2024-03-19T06:39:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.971+0000 7f9955a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9950157f30 con 0x7f99500c1e60 2024-03-19T06:39:18.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.971+0000 7f9955a00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9950152350 con 0x7f9950151f70 2024-03-19T06:39:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.972+0000 7f994f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99500c1e60 0x7f995006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.972+0000 7f994f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99500c1e60 0x7f995006e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45852/0 (socket says 172.21.15.17:45852) 2024-03-19T06:39:18.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.972+0000 7f994f400640 1 -- 172.21.15.17:0/598758902 learned_addr learned my addr 172.21.15.17:0/598758902 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:18.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.974+0000 7f994ea00640 1 --2- 172.21.15.17:0/598758902 >> v2:172.21.15.153:3300/0 conn(0x7f9950151f70 0x7f99500c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.975+0000 7f994f400640 1 -- 172.21.15.17:0/598758902 >> v2:172.21.15.153:3300/0 conn(0x7f9950151f70 msgr2=0x7f99500c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:18.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.975+0000 7f994f400640 1 --2- 172.21.15.17:0/598758902 >> v2:172.21.15.153:3300/0 conn(0x7f9950151f70 0x7f99500c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.975+0000 7f994f400640 1 -- 172.21.15.17:0/598758902 >> v1:172.21.15.153:6789/0 conn(0x7f995015b1d0 legacy=0x7f99501583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:18.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.976+0000 7f994f400640 1 -- 172.21.15.17:0/598758902 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950157be0 con 0x7f99500c1e60 2024-03-19T06:39:18.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.978+0000 7f994f400640 1 --2- 172.21.15.17:0/598758902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99500c1e60 0x7f995006e720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9950073010 tx=0x7f994802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7bf6eb293054ef server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.984+0000 7f994d600640 1 -- 172.21.15.17:0/598758902 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948034070 con 0x7f99500c1e60 2024-03-19T06:39:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.985+0000 7f994d600640 1 -- 172.21.15.17:0/598758902 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948030840 con 0x7f99500c1e60 2024-03-19T06:39:18.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.985+0000 7f994d600640 1 -- 172.21.15.17:0/598758902 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948030c10 con 0x7f99500c1e60 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.985+0000 7f9955a00640 1 -- 172.21.15.17:0/598758902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99500c1e60 msgr2=0x7f995006e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.985+0000 7f9955a00640 1 --2- 172.21.15.17:0/598758902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99500c1e60 0x7f995006e720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9950073010 tx=0x7f994802b980 comp rx=0 tx=0).stop 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 -- 172.21.15.17:0/598758902 shutdown_connections 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 --2- 172.21.15.17:0/598758902 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99500c1e60 0x7f995006e720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 --2- 172.21.15.17:0/598758902 >> v2:172.21.15.153:3300/0 conn(0x7f9950151f70 0x7f99500c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 -- 172.21.15.17:0/598758902 >> 172.21.15.17:0/598758902 conn(0x7f99500c8910 msgr2=0x7f99500cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 -- 172.21.15.17:0/598758902 shutdown_connections 2024-03-19T06:39:18.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.986+0000 7f9955a00640 1 -- 172.21.15.17:0/598758902 wait complete. 2024-03-19T06:39:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.988+0000 7f9955a00640 1 Processor -- start 2024-03-19T06:39:18.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.988+0000 7f9955a00640 1 -- start start 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99500c1e60 0x7f99501f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9950151f70 0x7f995015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995015bcf0 con 0x7f995015b1d0 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995015ba10 con 0x7f99500c1e60 2024-03-19T06:39:18.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.989+0000 7f9955a00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995015bfd0 con 0x7f9950151f70 2024-03-19T06:39:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.990+0000 7f994f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.990+0000 7f994f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45862/0 (socket says 172.21.15.17:45862) 2024-03-19T06:39:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.990+0000 7f994f400640 1 -- 172.21.15.17:0/1088347083 learned_addr learned my addr 172.21.15.17:0/1088347083 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:18.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.991+0000 7f994ea00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99500c1e60 0x7f99501f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:18.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.991+0000 7f994e000640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9950151f70 0x7f995015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:18.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.995+0000 7f994f400640 1 -- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9950151f70 msgr2=0x7f995015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:18.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.995+0000 7f994f400640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9950151f70 0x7f995015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:18.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.995+0000 7f994f400640 1 -- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99500c1e60 msgr2=0x7f99501f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:18.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.995+0000 7f994f400640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99500c1e60 0x7f99501f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:18.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.995+0000 7f994f400640 1 -- 172.21.15.17:0/1088347083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995014f850 con 0x7f995015b1d0 2024-03-19T06:39:18.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:18.997+0000 7f994f400640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9948009930 tx=0x7f9948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.002+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948048070 con 0x7f995015b1d0 2024-03-19T06:39:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.002+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948030640 con 0x7f995015b1d0 2024-03-19T06:39:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.002+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948034040 con 0x7f995015b1d0 2024-03-19T06:39:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.002+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995014e710 con 0x7f995015b1d0 2024-03-19T06:39:18.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.002+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995014e430 con 0x7f995015b1d0 2024-03-19T06:39:18.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.003+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950069be0 con 0x7f995015b1d0 2024-03-19T06:39:19.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.027+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f994804b070 con 0x7f995015b1d0 2024-03-19T06:39:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.028+0000 7f9946a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 0x7f992c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.029+0000 7f994ea00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 0x7f992c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:19.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.030+0000 7f994ea00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 0x7f992c06e0e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9940003b80 tx=0x7f99400098d0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.347+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f99480307f0 con 0x7f995015b1d0 2024-03-19T06:39:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.348+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f9948052020 con 0x7f995015b1d0 2024-03-19T06:39:19.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.568+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 --> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99500c7540 con 0x7f992c06bc20 2024-03-19T06:39:19.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.580+0000 7f9946a00640 1 -- 172.21.15.17:0/1088347083 <== mgr.4138 v2:172.21.15.17:6832/3774724855 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334046 (secure 0 0 0) 0x7f99500c7540 con 0x7f992c06bc20 2024-03-19T06:39:19.570 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:39:19.572 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-19T06:39:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 msgr2=0x7f992c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 0x7f992c06e0e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9940003b80 tx=0x7f99400098d0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 msgr2=0x7f99501efbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9948009930 tx=0x7f9948004730 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 shutdown_connections 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f995015b1d0 0x7f99501efbb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f9950151f70 0x7f995015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f992c06bc20 0x7f992c06e0e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 --2- 172.21.15.17:0/1088347083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99500c1e60 0x7f99501f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 >> 172.21.15.17:0/1088347083 conn(0x7f99500c8910 msgr2=0x7f99500c35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 shutdown_connections 2024-03-19T06:39:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.587+0000 7f9955a00640 1 -- 172.21.15.17:0/1088347083 wait complete. 2024-03-19T06:39:19.593 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":1019,"stamp":"2024-03-19T06:39:18.261560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":22602369,"num_objects":106,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":0,"num_read":597,"num_read_kb":611,"num_write":9426,"num_write_kb":277524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9499,"ondisk_log_size":9499,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":325576,"kb_used_data":47048,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754649144,"statfs":{"total":773094113280,"available":772760723456,"internally_reserved":0,"allocated":48177152,"data_stored":46337530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005420"},"pg_stats":[{"pgid":"2.1f","version":"32'665","reported_seq":722,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.716086+0000","last_change":"2024-03-19T06:38:51.716140+0000","last_active":"2024-03-19T06:38:51.716086+0000","last_peered":"2024-03-19T06:38:51.716086+0000","last_clean":"2024-03-19T06:38:51.716086+0000","last_became_active":"2024-03-19T06:06:33.097002+0000","last_became_peered":"2024-03-19T06:06:33.097002+0000","last_unstale":"2024-03-19T06:38:51.716086+0000","last_undegraded":"2024-03-19T06:38:51.716086+0000","last_fullsized":"2024-03-19T06:38:51.716086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'665","last_scrub_stamp":"2024-03-19T06:38:51.715990+0000","last_deep_scrub":"32'665","last_deep_scrub_stamp":"2024-03-19T06:38:51.715990+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.715990+0000","objects_scrubbed":7,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:50:57.164026+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":657,"num_write_kb":4461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"32'15","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.324310+0000","last_change":"2024-03-19T06:39:02.324427+0000","last_active":"2024-03-19T06:39:02.324310+0000","last_peered":"2024-03-19T06:39:02.324310+0000","last_clean":"2024-03-19T06:39:02.324310+0000","last_became_active":"2024-03-19T06:06:34.326768+0000","last_became_peered":"2024-03-19T06:06:34.326768+0000","last_unstale":"2024-03-19T06:39:02.324310+0000","last_undegraded":"2024-03-19T06:39:02.324310+0000","last_fullsized":"2024-03-19T06:39:02.324310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-19T06:39:02.324095+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-19T06:39:02.324095+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.324095+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:51:21.861501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'60","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:08.307683+0000","last_change":"2024-03-19T06:39:08.307834+0000","last_active":"2024-03-19T06:39:08.307683+0000","last_peered":"2024-03-19T06:39:08.307683+0000","last_clean":"2024-03-19T06:39:08.307683+0000","last_became_active":"2024-03-19T06:06:42.444293+0000","last_became_peered":"2024-03-19T06:06:42.444293+0000","last_unstale":"2024-03-19T06:39:08.307683+0000","last_undegraded":"2024-03-19T06:39:08.307683+0000","last_fullsized":"2024-03-19T06:39:08.307683+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-03-19T06:39:08.307379+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-03-19T06:39:08.307379+0000","last_clean_scrub_stamp":"2024-03-19T06:39:08.307379+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:48:08.765606+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"32'93","reported_seq":151,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.255477+0000","last_change":"2024-03-19T06:38:57.255519+0000","last_active":"2024-03-19T06:38:57.255477+0000","last_peered":"2024-03-19T06:38:57.255477+0000","last_clean":"2024-03-19T06:38:57.255477+0000","last_became_active":"2024-03-19T06:06:32.984828+0000","last_became_peered":"2024-03-19T06:06:32.984828+0000","last_unstale":"2024-03-19T06:38:57.255477+0000","last_undegraded":"2024-03-19T06:38:57.255477+0000","last_fullsized":"2024-03-19T06:38:57.255477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-03-19T06:38:57.255358+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-03-19T06:38:57.255358+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.255358+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:50:44.840418+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":914551,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":91,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'23","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.666450+0000","last_change":"2024-03-19T06:38:56.666508+0000","last_active":"2024-03-19T06:38:56.666450+0000","last_peered":"2024-03-19T06:38:56.666450+0000","last_clean":"2024-03-19T06:38:56.666450+0000","last_became_active":"2024-03-19T06:06:34.541382+0000","last_became_peered":"2024-03-19T06:06:34.541382+0000","last_unstale":"2024-03-19T06:38:56.666450+0000","last_undegraded":"2024-03-19T06:38:56.666450+0000","last_fullsized":"2024-03-19T06:38:56.666450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:38:56.666275+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:38:56.666275+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.666275+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:56:41.886024+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"32'63","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.337816+0000","last_change":"2024-03-19T06:39:02.337885+0000","last_active":"2024-03-19T06:39:02.337816+0000","last_peered":"2024-03-19T06:39:02.337816+0000","last_clean":"2024-03-19T06:39:02.337816+0000","last_became_active":"2024-03-19T06:06:42.158564+0000","last_became_peered":"2024-03-19T06:06:42.158564+0000","last_unstale":"2024-03-19T06:39:02.337816+0000","last_undegraded":"2024-03-19T06:39:02.337816+0000","last_fullsized":"2024-03-19T06:39:02.337816+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-03-19T06:39:02.337653+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-03-19T06:39:02.337653+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.337653+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:05:20.445536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'27","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.487828+0000","last_change":"2024-03-19T06:39:05.487903+0000","last_active":"2024-03-19T06:39:05.487828+0000","last_peered":"2024-03-19T06:39:05.487828+0000","last_clean":"2024-03-19T06:39:05.487828+0000","last_became_active":"2024-03-19T06:06:33.104670+0000","last_became_peered":"2024-03-19T06:06:33.104670+0000","last_unstale":"2024-03-19T06:39:05.487828+0000","last_undegraded":"2024-03-19T06:39:05.487828+0000","last_fullsized":"2024-03-19T06:39:05.487828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:39:05.487697+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:39:05.487697+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.487697+0000","objects_scrubbed":7,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:10.886438+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"32'21","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.278983+0000","last_change":"2024-03-19T06:39:02.278983+0000","last_active":"2024-03-19T06:39:02.278983+0000","last_peered":"2024-03-19T06:39:02.278983+0000","last_clean":"2024-03-19T06:39:02.278983+0000","last_became_active":"2024-03-19T06:06:34.535698+0000","last_became_peered":"2024-03-19T06:06:34.535698+0000","last_unstale":"2024-03-19T06:39:02.278983+0000","last_undegraded":"2024-03-19T06:39:02.278983+0000","last_fullsized":"2024-03-19T06:39:02.278983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-19T06:39:02.278740+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-19T06:39:02.278740+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.278740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:05:50.782008+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"32'72","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:08.419695+0000","last_change":"2024-03-19T06:39:08.419695+0000","last_active":"2024-03-19T06:39:08.419695+0000","last_peered":"2024-03-19T06:39:08.419695+0000","last_clean":"2024-03-19T06:39:08.419695+0000","last_became_active":"2024-03-19T06:07:02.158071+0000","last_became_peered":"2024-03-19T06:07:02.158071+0000","last_unstale":"2024-03-19T06:39:08.419695+0000","last_undegraded":"2024-03-19T06:39:08.419695+0000","last_fullsized":"2024-03-19T06:39:08.419695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'72","last_scrub_stamp":"2024-03-19T06:39:08.419462+0000","last_deep_scrub":"32'72","last_deep_scrub_stamp":"2024-03-19T06:39:08.419462+0000","last_clean_scrub_stamp":"2024-03-19T06:39:08.419462+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:05:56.922730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":7065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.418567+0000","last_change":"2024-03-19T06:39:00.418567+0000","last_active":"2024-03-19T06:39:00.418567+0000","last_peered":"2024-03-19T06:39:00.418567+0000","last_clean":"2024-03-19T06:39:00.418567+0000","last_became_active":"2024-03-19T06:06:33.098352+0000","last_became_peered":"2024-03-19T06:06:33.098352+0000","last_unstale":"2024-03-19T06:39:00.418567+0000","last_undegraded":"2024-03-19T06:39:00.418567+0000","last_fullsized":"2024-03-19T06:39:00.418567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:39:00.418333+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:39:00.418333+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.418333+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:17:51.194360+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.296940+0000","last_change":"2024-03-19T06:39:03.296940+0000","last_active":"2024-03-19T06:39:03.296940+0000","last_peered":"2024-03-19T06:39:03.296940+0000","last_clean":"2024-03-19T06:39:03.296940+0000","last_became_active":"2024-03-19T06:06:34.537860+0000","last_became_peered":"2024-03-19T06:06:34.537860+0000","last_unstale":"2024-03-19T06:39:03.296940+0000","last_undegraded":"2024-03-19T06:39:03.296940+0000","last_fullsized":"2024-03-19T06:39:03.296940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-03-19T06:39:03.296699+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-03-19T06:39:03.296699+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.296699+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:56:53.361481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'76","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.354976+0000","last_change":"2024-03-19T06:39:05.354976+0000","last_active":"2024-03-19T06:39:05.354976+0000","last_peered":"2024-03-19T06:39:05.354976+0000","last_clean":"2024-03-19T06:39:05.354976+0000","last_became_active":"2024-03-19T06:06:42.171550+0000","last_became_peered":"2024-03-19T06:06:42.171550+0000","last_unstale":"2024-03-19T06:39:05.354976+0000","last_undegraded":"2024-03-19T06:39:05.354976+0000","last_fullsized":"2024-03-19T06:39:05.354976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'76","last_scrub_stamp":"2024-03-19T06:39:05.354743+0000","last_deep_scrub":"32'76","last_deep_scrub_stamp":"2024-03-19T06:39:05.354743+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.354743+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:42:00.753798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":7060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'18","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.555216+0000","last_change":"2024-03-19T06:39:03.555216+0000","last_active":"2024-03-19T06:39:03.555216+0000","last_peered":"2024-03-19T06:39:03.555216+0000","last_clean":"2024-03-19T06:39:03.555216+0000","last_became_active":"2024-03-19T06:06:34.340623+0000","last_became_peered":"2024-03-19T06:06:34.340623+0000","last_unstale":"2024-03-19T06:39:03.555216+0000","last_undegraded":"2024-03-19T06:39:03.555216+0000","last_fullsized":"2024-03-19T06:39:03.555216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:39:03.554937+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:39:03.554937+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.554937+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:31:05.304267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"32'682","reported_seq":738,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.507697+0000","last_change":"2024-03-19T06:39:03.507779+0000","last_active":"2024-03-19T06:39:03.507697+0000","last_peered":"2024-03-19T06:39:03.507697+0000","last_clean":"2024-03-19T06:39:03.507697+0000","last_became_active":"2024-03-19T06:06:33.096592+0000","last_became_peered":"2024-03-19T06:06:33.096592+0000","last_unstale":"2024-03-19T06:39:03.507697+0000","last_undegraded":"2024-03-19T06:39:03.507697+0000","last_fullsized":"2024-03-19T06:39:03.507697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'682","last_scrub_stamp":"2024-03-19T06:39:03.507531+0000","last_deep_scrub":"32'682","last_deep_scrub_stamp":"2024-03-19T06:39:03.507531+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.507531+0000","objects_scrubbed":3,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:41:20.411543+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":673,"num_write_kb":4419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"32'61","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.399872+0000","last_change":"2024-03-19T06:39:06.399993+0000","last_active":"2024-03-19T06:39:06.399872+0000","last_peered":"2024-03-19T06:39:06.399872+0000","last_clean":"2024-03-19T06:39:06.399872+0000","last_became_active":"2024-03-19T06:06:42.173924+0000","last_became_peered":"2024-03-19T06:06:42.173924+0000","last_unstale":"2024-03-19T06:39:06.399872+0000","last_undegraded":"2024-03-19T06:39:06.399872+0000","last_fullsized":"2024-03-19T06:39:06.399872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-19T06:39:06.399552+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-19T06:39:06.399552+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.399552+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:06:47.257524+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":8781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'23","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.296338+0000","last_change":"2024-03-19T06:39:01.296397+0000","last_active":"2024-03-19T06:39:01.296338+0000","last_peered":"2024-03-19T06:39:01.296338+0000","last_clean":"2024-03-19T06:39:01.296338+0000","last_became_active":"2024-03-19T06:06:34.319889+0000","last_became_peered":"2024-03-19T06:06:34.319889+0000","last_unstale":"2024-03-19T06:39:01.296338+0000","last_undegraded":"2024-03-19T06:39:01.296338+0000","last_fullsized":"2024-03-19T06:39:01.296338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:39:01.296168+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:39:01.296168+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.296168+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:17.811362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'8","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.348718+0000","last_change":"2024-03-19T06:38:53.348718+0000","last_active":"2024-03-19T06:38:53.348718+0000","last_peered":"2024-03-19T06:38:53.348718+0000","last_clean":"2024-03-19T06:38:53.348718+0000","last_became_active":"2024-03-19T06:06:33.005233+0000","last_became_peered":"2024-03-19T06:06:33.005233+0000","last_unstale":"2024-03-19T06:38:53.348718+0000","last_undegraded":"2024-03-19T06:38:53.348718+0000","last_fullsized":"2024-03-19T06:38:53.348718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-19T06:38:53.348493+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-19T06:38:53.348493+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.348493+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:51:35.882331+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'90","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.359879+0000","last_change":"2024-03-19T06:39:01.359993+0000","last_active":"2024-03-19T06:39:01.359879+0000","last_peered":"2024-03-19T06:39:01.359879+0000","last_clean":"2024-03-19T06:39:01.359879+0000","last_became_active":"2024-03-19T06:06:42.157953+0000","last_became_peered":"2024-03-19T06:06:42.157953+0000","last_unstale":"2024-03-19T06:39:01.359879+0000","last_undegraded":"2024-03-19T06:39:01.359879+0000","last_fullsized":"2024-03-19T06:39:01.359879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'90","last_scrub_stamp":"2024-03-19T06:39:01.359694+0000","last_deep_scrub":"32'90","last_deep_scrub_stamp":"2024-03-19T06:39:01.359694+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.359694+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:23:19.076971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":8470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.308972+0000","last_change":"2024-03-19T06:38:55.308972+0000","last_active":"2024-03-19T06:38:55.308972+0000","last_peered":"2024-03-19T06:38:55.308972+0000","last_clean":"2024-03-19T06:38:55.308972+0000","last_became_active":"2024-03-19T06:06:34.586112+0000","last_became_peered":"2024-03-19T06:06:34.586112+0000","last_unstale":"2024-03-19T06:38:55.308972+0000","last_undegraded":"2024-03-19T06:38:55.308972+0000","last_fullsized":"2024-03-19T06:38:55.308972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:55.308676+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:55.308676+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.308676+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:27:10.912005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'14","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.358670+0000","last_change":"2024-03-19T06:38:56.358670+0000","last_active":"2024-03-19T06:38:56.358670+0000","last_peered":"2024-03-19T06:38:56.358670+0000","last_clean":"2024-03-19T06:38:56.358670+0000","last_became_active":"2024-03-19T06:06:33.096045+0000","last_became_peered":"2024-03-19T06:06:33.096045+0000","last_unstale":"2024-03-19T06:38:56.358670+0000","last_undegraded":"2024-03-19T06:38:56.358670+0000","last_fullsized":"2024-03-19T06:38:56.358670+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-03-19T06:38:56.358155+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-03-19T06:38:56.358155+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.358155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:56:41.577904+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"32'65","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.541201+0000","last_change":"2024-03-19T06:39:06.541328+0000","last_active":"2024-03-19T06:39:06.541201+0000","last_peered":"2024-03-19T06:39:06.541201+0000","last_clean":"2024-03-19T06:39:06.541201+0000","last_became_active":"2024-03-19T06:06:42.447241+0000","last_became_peered":"2024-03-19T06:06:42.447241+0000","last_unstale":"2024-03-19T06:39:06.541201+0000","last_undegraded":"2024-03-19T06:39:06.541201+0000","last_fullsized":"2024-03-19T06:39:06.541201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-03-19T06:39:06.540950+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-03-19T06:39:06.540950+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.540950+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:59:14.552076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":11230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.360085+0000","last_change":"2024-03-19T06:38:57.360085+0000","last_active":"2024-03-19T06:38:57.360085+0000","last_peered":"2024-03-19T06:38:57.360085+0000","last_clean":"2024-03-19T06:38:57.360085+0000","last_became_active":"2024-03-19T06:06:34.523711+0000","last_became_peered":"2024-03-19T06:06:34.523711+0000","last_unstale":"2024-03-19T06:38:57.360085+0000","last_undegraded":"2024-03-19T06:38:57.360085+0000","last_fullsized":"2024-03-19T06:38:57.360085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:38:57.359737+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:38:57.359737+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.359737+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:47:45.089657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"32'10","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.462456+0000","last_change":"2024-03-19T06:39:01.462456+0000","last_active":"2024-03-19T06:39:01.462456+0000","last_peered":"2024-03-19T06:39:01.462456+0000","last_clean":"2024-03-19T06:39:01.462456+0000","last_became_active":"2024-03-19T06:06:33.096809+0000","last_became_peered":"2024-03-19T06:06:33.096809+0000","last_unstale":"2024-03-19T06:39:01.462456+0000","last_undegraded":"2024-03-19T06:39:01.462456+0000","last_fullsized":"2024-03-19T06:39:01.462456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-19T06:39:01.462226+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-19T06:39:01.462226+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.462226+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:15.954706+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"32'67","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.379637+0000","last_change":"2024-03-19T06:39:00.379702+0000","last_active":"2024-03-19T06:39:00.379637+0000","last_peered":"2024-03-19T06:39:00.379637+0000","last_clean":"2024-03-19T06:39:00.379637+0000","last_became_active":"2024-03-19T06:06:42.158358+0000","last_became_peered":"2024-03-19T06:06:42.158358+0000","last_unstale":"2024-03-19T06:39:00.379637+0000","last_undegraded":"2024-03-19T06:39:00.379637+0000","last_fullsized":"2024-03-19T06:39:00.379637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2024-03-19T06:39:00.379461+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2024-03-19T06:39:00.379461+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.379461+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T06:52:22.328058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61,"num_write_kb":7128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'28","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.668335+0000","last_change":"2024-03-19T06:38:58.668335+0000","last_active":"2024-03-19T06:38:58.668335+0000","last_peered":"2024-03-19T06:38:58.668335+0000","last_clean":"2024-03-19T06:38:58.668335+0000","last_became_active":"2024-03-19T06:06:34.586215+0000","last_became_peered":"2024-03-19T06:06:34.586215+0000","last_unstale":"2024-03-19T06:38:58.668335+0000","last_undegraded":"2024-03-19T06:38:58.668335+0000","last_fullsized":"2024-03-19T06:38:58.668335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-19T06:38:58.668093+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-19T06:38:58.668093+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.668093+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:15.308156+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'19","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.613232+0000","last_change":"2024-03-19T06:38:56.613232+0000","last_active":"2024-03-19T06:38:56.613232+0000","last_peered":"2024-03-19T06:38:56.613232+0000","last_clean":"2024-03-19T06:38:56.613232+0000","last_became_active":"2024-03-19T06:06:33.107293+0000","last_became_peered":"2024-03-19T06:06:33.107293+0000","last_unstale":"2024-03-19T06:38:56.613232+0000","last_undegraded":"2024-03-19T06:38:56.613232+0000","last_fullsized":"2024-03-19T06:38:56.613232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:56.612929+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:56.612929+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.612929+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:28:29.764669+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"32'50","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.378652+0000","last_change":"2024-03-19T06:39:07.378728+0000","last_active":"2024-03-19T06:39:07.378652+0000","last_peered":"2024-03-19T06:39:07.378652+0000","last_clean":"2024-03-19T06:39:07.378652+0000","last_became_active":"2024-03-19T06:06:42.445230+0000","last_became_peered":"2024-03-19T06:06:42.445230+0000","last_unstale":"2024-03-19T06:39:07.378652+0000","last_undegraded":"2024-03-19T06:39:07.378652+0000","last_fullsized":"2024-03-19T06:39:07.378652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'50","last_scrub_stamp":"2024-03-19T06:39:07.378481+0000","last_deep_scrub":"32'50","last_deep_scrub_stamp":"2024-03-19T06:39:07.378481+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.378481+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:12.777221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":9639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.283496+0000","last_change":"2024-03-19T06:39:05.283496+0000","last_active":"2024-03-19T06:39:05.283496+0000","last_peered":"2024-03-19T06:39:05.283496+0000","last_clean":"2024-03-19T06:39:05.283496+0000","last_became_active":"2024-03-19T06:06:34.596814+0000","last_became_peered":"2024-03-19T06:06:34.596814+0000","last_unstale":"2024-03-19T06:39:05.283496+0000","last_undegraded":"2024-03-19T06:39:05.283496+0000","last_fullsized":"2024-03-19T06:39:05.283496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:39:05.283261+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:39:05.283261+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.283261+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:04:09.316829+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"32'1213","reported_seq":1270,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.328768+0000","last_change":"2024-03-19T06:38:57.328768+0000","last_active":"2024-03-19T06:38:57.328768+0000","last_peered":"2024-03-19T06:38:57.328768+0000","last_clean":"2024-03-19T06:38:57.328768+0000","last_became_active":"2024-03-19T06:06:33.106493+0000","last_became_peered":"2024-03-19T06:06:33.106493+0000","last_unstale":"2024-03-19T06:38:57.328768+0000","last_undegraded":"2024-03-19T06:38:57.328768+0000","last_fullsized":"2024-03-19T06:38:57.328768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'1213","last_scrub_stamp":"2024-03-19T06:38:57.328512+0000","last_deep_scrub":"32'1213","last_deep_scrub_stamp":"2024-03-19T06:38:57.328512+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.328512+0000","objects_scrubbed":4,"log_size":1213,"log_dups_size":0,"ondisk_log_size":1213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:02:51.232654+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2921,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"32'85","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:11.313580+0000","last_change":"2024-03-19T06:39:11.313647+0000","last_active":"2024-03-19T06:39:11.313580+0000","last_peered":"2024-03-19T06:39:11.313580+0000","last_clean":"2024-03-19T06:39:11.313580+0000","last_became_active":"2024-03-19T06:07:02.245026+0000","last_became_peered":"2024-03-19T06:07:02.245026+0000","last_unstale":"2024-03-19T06:39:11.313580+0000","last_undegraded":"2024-03-19T06:39:11.313580+0000","last_fullsized":"2024-03-19T06:39:11.313580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'85","last_scrub_stamp":"2024-03-19T06:39:11.313396+0000","last_deep_scrub":"32'85","last_deep_scrub_stamp":"2024-03-19T06:39:11.313396+0000","last_clean_scrub_stamp":"2024-03-19T06:39:11.313396+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:15:12.092562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":11129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'23","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.376461+0000","last_change":"2024-03-19T06:39:00.376519+0000","last_active":"2024-03-19T06:39:00.376461+0000","last_peered":"2024-03-19T06:39:00.376461+0000","last_clean":"2024-03-19T06:39:00.376461+0000","last_became_active":"2024-03-19T06:06:34.587589+0000","last_became_peered":"2024-03-19T06:06:34.587589+0000","last_unstale":"2024-03-19T06:39:00.376461+0000","last_undegraded":"2024-03-19T06:39:00.376461+0000","last_fullsized":"2024-03-19T06:39:00.376461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:39:00.376289+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:39:00.376289+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.376289+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:44:36.582704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"32'9","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.516704+0000","last_change":"2024-03-19T06:39:04.516831+0000","last_active":"2024-03-19T06:39:04.516704+0000","last_peered":"2024-03-19T06:39:04.516704+0000","last_clean":"2024-03-19T06:39:04.516704+0000","last_became_active":"2024-03-19T06:06:33.100025+0000","last_became_peered":"2024-03-19T06:06:33.100025+0000","last_unstale":"2024-03-19T06:39:04.516704+0000","last_undegraded":"2024-03-19T06:39:04.516704+0000","last_fullsized":"2024-03-19T06:39:04.516704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:39:04.516516+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:39:04.516516+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.516516+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:27:20.119845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"32'48","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.735376+0000","last_change":"2024-03-19T06:39:05.735443+0000","last_active":"2024-03-19T06:39:05.735376+0000","last_peered":"2024-03-19T06:39:05.735376+0000","last_clean":"2024-03-19T06:39:05.735376+0000","last_became_active":"2024-03-19T06:06:42.450737+0000","last_became_peered":"2024-03-19T06:06:42.450737+0000","last_unstale":"2024-03-19T06:39:05.735376+0000","last_undegraded":"2024-03-19T06:39:05.735376+0000","last_fullsized":"2024-03-19T06:39:05.735376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-03-19T06:39:05.735190+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-03-19T06:39:05.735190+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.735190+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:16:18.429971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":5603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"32'20","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.345566+0000","last_change":"2024-03-19T06:38:55.345637+0000","last_active":"2024-03-19T06:38:55.345566+0000","last_peered":"2024-03-19T06:38:55.345566+0000","last_clean":"2024-03-19T06:38:55.345566+0000","last_became_active":"2024-03-19T06:06:34.537814+0000","last_became_peered":"2024-03-19T06:06:34.537814+0000","last_unstale":"2024-03-19T06:38:55.345566+0000","last_undegraded":"2024-03-19T06:38:55.345566+0000","last_fullsized":"2024-03-19T06:38:55.345566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-19T06:38:55.345363+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-19T06:38:55.345363+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.345363+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:32:33.484867+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.354368+0000","last_change":"2024-03-19T06:38:52.354432+0000","last_active":"2024-03-19T06:38:52.354368+0000","last_peered":"2024-03-19T06:38:52.354368+0000","last_clean":"2024-03-19T06:38:52.354368+0000","last_became_active":"2024-03-19T06:06:33.003484+0000","last_became_peered":"2024-03-19T06:06:33.003484+0000","last_unstale":"2024-03-19T06:38:52.354368+0000","last_undegraded":"2024-03-19T06:38:52.354368+0000","last_fullsized":"2024-03-19T06:38:52.354368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-19T06:38:52.354205+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-19T06:38:52.354205+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.354205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:43:05.945906+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'69","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.447953+0000","last_change":"2024-03-19T06:39:03.448017+0000","last_active":"2024-03-19T06:39:03.447953+0000","last_peered":"2024-03-19T06:39:03.447953+0000","last_clean":"2024-03-19T06:39:03.447953+0000","last_became_active":"2024-03-19T06:06:42.169228+0000","last_became_peered":"2024-03-19T06:06:42.169228+0000","last_unstale":"2024-03-19T06:39:03.447953+0000","last_undegraded":"2024-03-19T06:39:03.447953+0000","last_fullsized":"2024-03-19T06:39:03.447953+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'69","last_scrub_stamp":"2024-03-19T06:39:03.447732+0000","last_deep_scrub":"32'69","last_deep_scrub_stamp":"2024-03-19T06:39:03.447732+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.447732+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:36:33.713060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":6450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"32'20","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.284947+0000","last_change":"2024-03-19T06:38:55.285009+0000","last_active":"2024-03-19T06:38:55.284947+0000","last_peered":"2024-03-19T06:38:55.284947+0000","last_clean":"2024-03-19T06:38:55.284947+0000","last_became_active":"2024-03-19T06:06:34.347757+0000","last_became_peered":"2024-03-19T06:06:34.347757+0000","last_unstale":"2024-03-19T06:38:55.284947+0000","last_undegraded":"2024-03-19T06:38:55.284947+0000","last_fullsized":"2024-03-19T06:38:55.284947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-19T06:38:55.284760+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-19T06:38:55.284760+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.284760+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:38:05.792627+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'12","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.297614+0000","last_change":"2024-03-19T06:38:59.297682+0000","last_active":"2024-03-19T06:38:59.297614+0000","last_peered":"2024-03-19T06:38:59.297614+0000","last_clean":"2024-03-19T06:38:59.297614+0000","last_became_active":"2024-03-19T06:06:33.098101+0000","last_became_peered":"2024-03-19T06:06:33.098101+0000","last_unstale":"2024-03-19T06:38:59.297614+0000","last_undegraded":"2024-03-19T06:38:59.297614+0000","last_fullsized":"2024-03-19T06:38:59.297614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-19T06:38:59.297438+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-19T06:38:59.297438+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.297438+0000","objects_scrubbed":2,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:41:16.201450+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"32'57","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.400557+0000","last_change":"2024-03-19T06:39:02.400621+0000","last_active":"2024-03-19T06:39:02.400557+0000","last_peered":"2024-03-19T06:39:02.400557+0000","last_clean":"2024-03-19T06:39:02.400557+0000","last_became_active":"2024-03-19T06:06:42.161951+0000","last_became_peered":"2024-03-19T06:06:42.161951+0000","last_unstale":"2024-03-19T06:39:02.400557+0000","last_undegraded":"2024-03-19T06:39:02.400557+0000","last_fullsized":"2024-03-19T06:39:02.400557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'57","last_scrub_stamp":"2024-03-19T06:39:02.400378+0000","last_deep_scrub":"32'57","last_deep_scrub_stamp":"2024-03-19T06:39:02.400378+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.400378+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.279174+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"32'24","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.356217+0000","last_change":"2024-03-19T06:39:01.356326+0000","last_active":"2024-03-19T06:39:01.356217+0000","last_peered":"2024-03-19T06:39:01.356217+0000","last_clean":"2024-03-19T06:39:01.356217+0000","last_became_active":"2024-03-19T06:06:34.590408+0000","last_became_peered":"2024-03-19T06:06:34.590408+0000","last_unstale":"2024-03-19T06:39:01.356217+0000","last_undegraded":"2024-03-19T06:39:01.356217+0000","last_fullsized":"2024-03-19T06:39:01.356217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-03-19T06:39:01.356002+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-03-19T06:39:01.356002+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.356002+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:32.051195+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"32'500","reported_seq":1038,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.620321+0000","last_change":"2024-03-19T06:38:51.620352+0000","last_active":"2024-03-19T06:38:51.620321+0000","last_peered":"2024-03-19T06:38:51.620321+0000","last_clean":"2024-03-19T06:38:51.620321+0000","last_became_active":"2024-03-19T06:06:33.086686+0000","last_became_peered":"2024-03-19T06:06:33.086686+0000","last_unstale":"2024-03-19T06:38:51.620321+0000","last_undegraded":"2024-03-19T06:38:51.620321+0000","last_fullsized":"2024-03-19T06:38:51.620321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'500","last_scrub_stamp":"2024-03-19T06:38:51.620253+0000","last_deep_scrub":"32'500","last_deep_scrub_stamp":"2024-03-19T06:38:51.620253+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.620253+0000","objects_scrubbed":4,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:36:15.245756+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117202,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":494,"num_write_kb":519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'60","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.457674+0000","last_change":"2024-03-19T06:39:04.457674+0000","last_active":"2024-03-19T06:39:04.457674+0000","last_peered":"2024-03-19T06:39:04.457674+0000","last_clean":"2024-03-19T06:39:04.457674+0000","last_became_active":"2024-03-19T06:06:42.173756+0000","last_became_peered":"2024-03-19T06:06:42.173756+0000","last_unstale":"2024-03-19T06:39:04.457674+0000","last_undegraded":"2024-03-19T06:39:04.457674+0000","last_fullsized":"2024-03-19T06:39:04.457674+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'60","last_scrub_stamp":"2024-03-19T06:39:04.457322+0000","last_deep_scrub":"32'60","last_deep_scrub_stamp":"2024-03-19T06:39:04.457322+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.457322+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T18:28:37.513588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":6246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"32'13","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.683814+0000","last_change":"2024-03-19T06:38:53.683873+0000","last_active":"2024-03-19T06:38:53.683814+0000","last_peered":"2024-03-19T06:38:53.683814+0000","last_clean":"2024-03-19T06:38:53.683814+0000","last_became_active":"2024-03-19T06:06:34.339134+0000","last_became_peered":"2024-03-19T06:06:34.339134+0000","last_unstale":"2024-03-19T06:38:53.683814+0000","last_undegraded":"2024-03-19T06:38:53.683814+0000","last_fullsized":"2024-03-19T06:38:53.683814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-03-19T06:38:53.683609+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-03-19T06:38:53.683609+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.683609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:51:36.217447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'13","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.501729+0000","last_change":"2024-03-19T06:39:02.501799+0000","last_active":"2024-03-19T06:39:02.501729+0000","last_peered":"2024-03-19T06:39:02.501729+0000","last_clean":"2024-03-19T06:39:02.501729+0000","last_became_active":"2024-03-19T06:06:33.097641+0000","last_became_peered":"2024-03-19T06:06:33.097641+0000","last_unstale":"2024-03-19T06:39:02.501729+0000","last_undegraded":"2024-03-19T06:39:02.501729+0000","last_fullsized":"2024-03-19T06:39:02.501729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-03-19T06:39:02.501556+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-03-19T06:39:02.501556+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.501556+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:41.071816+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"32'93","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.695746+0000","last_change":"2024-03-19T06:39:03.695746+0000","last_active":"2024-03-19T06:39:03.695746+0000","last_peered":"2024-03-19T06:39:03.695746+0000","last_clean":"2024-03-19T06:39:03.695746+0000","last_became_active":"2024-03-19T06:06:42.445736+0000","last_became_peered":"2024-03-19T06:06:42.445736+0000","last_unstale":"2024-03-19T06:39:03.695746+0000","last_undegraded":"2024-03-19T06:39:03.695746+0000","last_fullsized":"2024-03-19T06:39:03.695746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-03-19T06:39:03.695254+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-03-19T06:39:03.695254+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.695254+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:36:33.960582+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":9446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"32'18","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.268888+0000","last_change":"2024-03-19T06:38:53.268920+0000","last_active":"2024-03-19T06:38:53.268888+0000","last_peered":"2024-03-19T06:38:53.268888+0000","last_clean":"2024-03-19T06:38:53.268888+0000","last_became_active":"2024-03-19T06:06:34.546352+0000","last_became_peered":"2024-03-19T06:06:34.546352+0000","last_unstale":"2024-03-19T06:38:53.268888+0000","last_undegraded":"2024-03-19T06:38:53.268888+0000","last_fullsized":"2024-03-19T06:38:53.268888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:53.268793+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:53.268793+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.268793+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:31.839053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.309101+0000","last_change":"2024-03-19T06:38:57.309175+0000","last_active":"2024-03-19T06:38:57.309101+0000","last_peered":"2024-03-19T06:38:57.309101+0000","last_clean":"2024-03-19T06:38:57.309101+0000","last_became_active":"2024-03-19T06:06:33.094453+0000","last_became_peered":"2024-03-19T06:06:33.094453+0000","last_unstale":"2024-03-19T06:38:57.309101+0000","last_undegraded":"2024-03-19T06:38:57.309101+0000","last_fullsized":"2024-03-19T06:38:57.309101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:38:57.308987+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:38:57.308987+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.308987+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:11.801467+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":215,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.447427+0000","last_change":"2024-03-19T06:38:59.447503+0000","last_active":"2024-03-19T06:38:59.447427+0000","last_peered":"2024-03-19T06:38:59.447427+0000","last_clean":"2024-03-19T06:38:59.447427+0000","last_became_active":"2024-03-19T06:06:10.118284+0000","last_became_peered":"2024-03-19T06:06:10.118284+0000","last_unstale":"2024-03-19T06:38:59.447427+0000","last_undegraded":"2024-03-19T06:38:59.447427+0000","last_fullsized":"2024-03-19T06:38:59.447427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-03-19T06:38:59.447252+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-03-19T06:38:59.447252+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.447252+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:23:17.164528+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"32'67","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:10.618117+0000","last_change":"2024-03-19T06:39:10.618180+0000","last_active":"2024-03-19T06:39:10.618117+0000","last_peered":"2024-03-19T06:39:10.618117+0000","last_clean":"2024-03-19T06:39:10.618117+0000","last_became_active":"2024-03-19T06:06:42.452957+0000","last_became_peered":"2024-03-19T06:06:42.452957+0000","last_unstale":"2024-03-19T06:39:10.618117+0000","last_undegraded":"2024-03-19T06:39:10.618117+0000","last_fullsized":"2024-03-19T06:39:10.618117+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'67","last_scrub_stamp":"2024-03-19T06:39:10.617898+0000","last_deep_scrub":"32'67","last_deep_scrub_stamp":"2024-03-19T06:39:10.617898+0000","last_clean_scrub_stamp":"2024-03-19T06:39:10.617898+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:05:10.646579+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":6758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"32'22","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:14.401330+0000","last_change":"2024-03-19T06:39:14.401391+0000","last_active":"2024-03-19T06:39:14.401330+0000","last_peered":"2024-03-19T06:39:14.401330+0000","last_clean":"2024-03-19T06:39:14.401330+0000","last_became_active":"2024-03-19T06:06:34.599058+0000","last_became_peered":"2024-03-19T06:06:34.599058+0000","last_unstale":"2024-03-19T06:39:14.401330+0000","last_undegraded":"2024-03-19T06:39:14.401330+0000","last_fullsized":"2024-03-19T06:39:14.401330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:14.401159+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:14.401159+0000","last_clean_scrub_stamp":"2024-03-19T06:39:14.401159+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:41.389734+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'12","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.537334+0000","last_change":"2024-03-19T06:38:54.537404+0000","last_active":"2024-03-19T06:38:54.537334+0000","last_peered":"2024-03-19T06:38:54.537334+0000","last_clean":"2024-03-19T06:38:54.537334+0000","last_became_active":"2024-03-19T06:06:33.094438+0000","last_became_peered":"2024-03-19T06:06:33.094438+0000","last_unstale":"2024-03-19T06:38:54.537334+0000","last_undegraded":"2024-03-19T06:38:54.537334+0000","last_fullsized":"2024-03-19T06:38:54.537334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-19T06:38:54.537171+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-19T06:38:54.537171+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.537171+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:04:29.895117+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"32'77","reported_seq":122,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:09.568978+0000","last_change":"2024-03-19T06:39:09.568978+0000","last_active":"2024-03-19T06:39:09.568978+0000","last_peered":"2024-03-19T06:39:09.568978+0000","last_clean":"2024-03-19T06:39:09.568978+0000","last_became_active":"2024-03-19T06:06:42.447908+0000","last_became_peered":"2024-03-19T06:06:42.447908+0000","last_unstale":"2024-03-19T06:39:09.568978+0000","last_undegraded":"2024-03-19T06:39:09.568978+0000","last_fullsized":"2024-03-19T06:39:09.568978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-03-19T06:39:09.568733+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-03-19T06:39:09.568733+0000","last_clean_scrub_stamp":"2024-03-19T06:39:09.568733+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:30:08.429587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":6371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"32'20","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.284104+0000","last_change":"2024-03-19T06:39:01.284218+0000","last_active":"2024-03-19T06:39:01.284104+0000","last_peered":"2024-03-19T06:39:01.284104+0000","last_clean":"2024-03-19T06:39:01.284104+0000","last_became_active":"2024-03-19T06:06:34.535124+0000","last_became_peered":"2024-03-19T06:06:34.535124+0000","last_unstale":"2024-03-19T06:39:01.284104+0000","last_undegraded":"2024-03-19T06:39:01.284104+0000","last_fullsized":"2024-03-19T06:39:01.284104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-19T06:39:01.283866+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-19T06:39:01.283866+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.283866+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:48:06.682607+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.356877+0000","last_change":"2024-03-19T06:38:54.356918+0000","last_active":"2024-03-19T06:38:54.356877+0000","last_peered":"2024-03-19T06:38:54.356877+0000","last_clean":"2024-03-19T06:38:54.356877+0000","last_became_active":"2024-03-19T06:06:33.075701+0000","last_became_peered":"2024-03-19T06:06:33.075701+0000","last_unstale":"2024-03-19T06:38:54.356877+0000","last_undegraded":"2024-03-19T06:38:54.356877+0000","last_fullsized":"2024-03-19T06:38:54.356877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:38:54.356768+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:38:54.356768+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.356768+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:15:21.672961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"32'101","reported_seq":145,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.701757+0000","last_change":"2024-03-19T06:39:01.701927+0000","last_active":"2024-03-19T06:39:01.701757+0000","last_peered":"2024-03-19T06:39:01.701757+0000","last_clean":"2024-03-19T06:39:01.701757+0000","last_became_active":"2024-03-19T06:06:42.170869+0000","last_became_peered":"2024-03-19T06:06:42.170869+0000","last_unstale":"2024-03-19T06:39:01.701757+0000","last_undegraded":"2024-03-19T06:39:01.701757+0000","last_fullsized":"2024-03-19T06:39:01.701757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-03-19T06:39:01.701548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-03-19T06:39:01.701548+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.701548+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:18:32.396740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":97,"num_write_kb":8077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'23","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:13.425631+0000","last_change":"2024-03-19T06:39:13.425694+0000","last_active":"2024-03-19T06:39:13.425631+0000","last_peered":"2024-03-19T06:39:13.425631+0000","last_clean":"2024-03-19T06:39:13.425631+0000","last_became_active":"2024-03-19T06:06:34.598274+0000","last_became_peered":"2024-03-19T06:06:34.598274+0000","last_unstale":"2024-03-19T06:39:13.425631+0000","last_undegraded":"2024-03-19T06:39:13.425631+0000","last_fullsized":"2024-03-19T06:39:13.425631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:39:13.425453+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:39:13.425453+0000","last_clean_scrub_stamp":"2024-03-19T06:39:13.425453+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:23.738885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'8","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:53.572119+0000","last_change":"2024-03-19T06:38:53.572167+0000","last_active":"2024-03-19T06:38:53.572119+0000","last_peered":"2024-03-19T06:38:53.572119+0000","last_clean":"2024-03-19T06:38:53.572119+0000","last_became_active":"2024-03-19T06:06:33.089665+0000","last_became_peered":"2024-03-19T06:06:33.089665+0000","last_unstale":"2024-03-19T06:38:53.572119+0000","last_undegraded":"2024-03-19T06:38:53.572119+0000","last_fullsized":"2024-03-19T06:38:53.572119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-19T06:38:53.572012+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-19T06:38:53.572012+0000","last_clean_scrub_stamp":"2024-03-19T06:38:53.572012+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:30:06.654175+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"32'66","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:11.273440+0000","last_change":"2024-03-19T06:39:11.273440+0000","last_active":"2024-03-19T06:39:11.273440+0000","last_peered":"2024-03-19T06:39:11.273440+0000","last_clean":"2024-03-19T06:39:11.273440+0000","last_became_active":"2024-03-19T06:06:42.449949+0000","last_became_peered":"2024-03-19T06:06:42.449949+0000","last_unstale":"2024-03-19T06:39:11.273440+0000","last_undegraded":"2024-03-19T06:39:11.273440+0000","last_fullsized":"2024-03-19T06:39:11.273440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-03-19T06:39:11.273185+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-03-19T06:39:11.273185+0000","last_clean_scrub_stamp":"2024-03-19T06:39:11.273185+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:04:15.306753+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":5722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'16","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:12.474132+0000","last_change":"2024-03-19T06:39:12.474192+0000","last_active":"2024-03-19T06:39:12.474132+0000","last_peered":"2024-03-19T06:39:12.474132+0000","last_clean":"2024-03-19T06:39:12.474132+0000","last_became_active":"2024-03-19T06:06:34.597482+0000","last_became_peered":"2024-03-19T06:06:34.597482+0000","last_unstale":"2024-03-19T06:39:12.474132+0000","last_undegraded":"2024-03-19T06:39:12.474132+0000","last_fullsized":"2024-03-19T06:39:12.474132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:39:12.473924+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:39:12.473924+0000","last_clean_scrub_stamp":"2024-03-19T06:39:12.473924+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:51:32.011330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"32'10","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.322366+0000","last_change":"2024-03-19T06:38:54.322493+0000","last_active":"2024-03-19T06:38:54.322366+0000","last_peered":"2024-03-19T06:38:54.322366+0000","last_clean":"2024-03-19T06:38:54.322366+0000","last_became_active":"2024-03-19T06:06:33.076625+0000","last_became_peered":"2024-03-19T06:06:33.076625+0000","last_unstale":"2024-03-19T06:38:54.322366+0000","last_undegraded":"2024-03-19T06:38:54.322366+0000","last_fullsized":"2024-03-19T06:38:54.322366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-19T06:38:54.322166+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-19T06:38:54.322166+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.322166+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:20:18.862934+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"32'94","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.342137+0000","last_change":"2024-03-19T06:39:04.342137+0000","last_active":"2024-03-19T06:39:04.342137+0000","last_peered":"2024-03-19T06:39:04.342137+0000","last_clean":"2024-03-19T06:39:04.342137+0000","last_became_active":"2024-03-19T06:06:42.163567+0000","last_became_peered":"2024-03-19T06:06:42.163567+0000","last_unstale":"2024-03-19T06:39:04.342137+0000","last_undegraded":"2024-03-19T06:39:04.342137+0000","last_fullsized":"2024-03-19T06:39:04.342137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'94","last_scrub_stamp":"2024-03-19T06:39:04.341854+0000","last_deep_scrub":"32'94","last_deep_scrub_stamp":"2024-03-19T06:39:04.341854+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.341854+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:42.912114+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":87,"num_write_kb":11669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"32'23","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.487854+0000","last_change":"2024-03-19T06:38:58.487854+0000","last_active":"2024-03-19T06:38:58.487854+0000","last_peered":"2024-03-19T06:38:58.487854+0000","last_clean":"2024-03-19T06:38:58.487854+0000","last_became_active":"2024-03-19T06:06:34.593327+0000","last_became_peered":"2024-03-19T06:06:34.593327+0000","last_unstale":"2024-03-19T06:38:58.487854+0000","last_undegraded":"2024-03-19T06:38:58.487854+0000","last_fullsized":"2024-03-19T06:38:58.487854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:38:58.487620+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:38:58.487620+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.487620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:45:26.851252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"32'27","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.622172+0000","last_change":"2024-03-19T06:38:52.622172+0000","last_active":"2024-03-19T06:38:52.622172+0000","last_peered":"2024-03-19T06:38:52.622172+0000","last_clean":"2024-03-19T06:38:52.622172+0000","last_became_active":"2024-03-19T06:06:33.088703+0000","last_became_peered":"2024-03-19T06:06:33.088703+0000","last_unstale":"2024-03-19T06:38:52.622172+0000","last_undegraded":"2024-03-19T06:38:52.622172+0000","last_fullsized":"2024-03-19T06:38:52.622172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:38:52.621881+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:38:52.621881+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.621881+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:36:16.570622+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"32'78","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.697285+0000","last_change":"2024-03-19T06:39:02.697352+0000","last_active":"2024-03-19T06:39:02.697285+0000","last_peered":"2024-03-19T06:39:02.697285+0000","last_clean":"2024-03-19T06:39:02.697285+0000","last_became_active":"2024-03-19T06:06:42.175384+0000","last_became_peered":"2024-03-19T06:06:42.175384+0000","last_unstale":"2024-03-19T06:39:02.697285+0000","last_undegraded":"2024-03-19T06:39:02.697285+0000","last_fullsized":"2024-03-19T06:39:02.697285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'78","last_scrub_stamp":"2024-03-19T06:39:02.697087+0000","last_deep_scrub":"32'78","last_deep_scrub_stamp":"2024-03-19T06:39:02.697087+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.697087+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:28:03.575883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":7031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'22","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:02.535506+0000","last_change":"2024-03-19T06:39:02.535506+0000","last_active":"2024-03-19T06:39:02.535506+0000","last_peered":"2024-03-19T06:39:02.535506+0000","last_clean":"2024-03-19T06:39:02.535506+0000","last_became_active":"2024-03-19T06:06:34.330554+0000","last_became_peered":"2024-03-19T06:06:34.330554+0000","last_unstale":"2024-03-19T06:39:02.535506+0000","last_undegraded":"2024-03-19T06:39:02.535506+0000","last_fullsized":"2024-03-19T06:39:02.535506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:02.535261+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:02.535261+0000","last_clean_scrub_stamp":"2024-03-19T06:39:02.535261+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:41:09.478848+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"32'9","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.615406+0000","last_change":"2024-03-19T06:38:58.615406+0000","last_active":"2024-03-19T06:38:58.615406+0000","last_peered":"2024-03-19T06:38:58.615406+0000","last_clean":"2024-03-19T06:38:58.615406+0000","last_became_active":"2024-03-19T06:06:33.110267+0000","last_became_peered":"2024-03-19T06:06:33.110267+0000","last_unstale":"2024-03-19T06:38:58.615406+0000","last_undegraded":"2024-03-19T06:38:58.615406+0000","last_fullsized":"2024-03-19T06:38:58.615406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:38:58.615023+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:38:58.615023+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.615023+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:18:49.455905+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"32'70","reported_seq":113,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:09.296139+0000","last_change":"2024-03-19T06:39:09.296258+0000","last_active":"2024-03-19T06:39:09.296139+0000","last_peered":"2024-03-19T06:39:09.296139+0000","last_clean":"2024-03-19T06:39:09.296139+0000","last_became_active":"2024-03-19T06:06:42.444658+0000","last_became_peered":"2024-03-19T06:06:42.444658+0000","last_unstale":"2024-03-19T06:39:09.296139+0000","last_undegraded":"2024-03-19T06:39:09.296139+0000","last_fullsized":"2024-03-19T06:39:09.296139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'70","last_scrub_stamp":"2024-03-19T06:39:09.295861+0000","last_deep_scrub":"32'70","last_deep_scrub_stamp":"2024-03-19T06:39:09.295861+0000","last_clean_scrub_stamp":"2024-03-19T06:39:09.295861+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:14:58.257335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":6939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"32'36","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.424167+0000","last_change":"2024-03-19T06:39:07.424167+0000","last_active":"2024-03-19T06:39:07.424167+0000","last_peered":"2024-03-19T06:39:07.424167+0000","last_clean":"2024-03-19T06:39:07.424167+0000","last_became_active":"2024-03-19T06:06:34.594354+0000","last_became_peered":"2024-03-19T06:06:34.594354+0000","last_unstale":"2024-03-19T06:39:07.424167+0000","last_undegraded":"2024-03-19T06:39:07.424167+0000","last_fullsized":"2024-03-19T06:39:07.424167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-03-19T06:39:07.423810+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-03-19T06:39:07.423810+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.423810+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:56:57.488593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'11","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.326909+0000","last_change":"2024-03-19T06:38:56.326909+0000","last_active":"2024-03-19T06:38:56.326909+0000","last_peered":"2024-03-19T06:38:56.326909+0000","last_clean":"2024-03-19T06:38:56.326909+0000","last_became_active":"2024-03-19T06:06:33.091941+0000","last_became_peered":"2024-03-19T06:06:33.091941+0000","last_unstale":"2024-03-19T06:38:56.326909+0000","last_undegraded":"2024-03-19T06:38:56.326909+0000","last_fullsized":"2024-03-19T06:38:56.326909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'11","last_scrub_stamp":"2024-03-19T06:38:56.326649+0000","last_deep_scrub":"32'11","last_deep_scrub_stamp":"2024-03-19T06:38:56.326649+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.326649+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:05:14.434532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'64","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:12.317774+0000","last_change":"2024-03-19T06:39:12.317916+0000","last_active":"2024-03-19T06:39:12.317774+0000","last_peered":"2024-03-19T06:39:12.317774+0000","last_clean":"2024-03-19T06:39:12.317774+0000","last_became_active":"2024-03-19T06:07:02.250314+0000","last_became_peered":"2024-03-19T06:07:02.250314+0000","last_unstale":"2024-03-19T06:39:12.317774+0000","last_undegraded":"2024-03-19T06:39:12.317774+0000","last_fullsized":"2024-03-19T06:39:12.317774+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'64","last_scrub_stamp":"2024-03-19T06:39:12.317485+0000","last_deep_scrub":"32'64","last_deep_scrub_stamp":"2024-03-19T06:39:12.317485+0000","last_clean_scrub_stamp":"2024-03-19T06:39:12.317485+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:08:24.556711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"32'27","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.716551+0000","last_change":"2024-03-19T06:39:00.716551+0000","last_active":"2024-03-19T06:39:00.716551+0000","last_peered":"2024-03-19T06:39:00.716551+0000","last_clean":"2024-03-19T06:39:00.716551+0000","last_became_active":"2024-03-19T06:06:34.596807+0000","last_became_peered":"2024-03-19T06:06:34.596807+0000","last_unstale":"2024-03-19T06:39:00.716551+0000","last_undegraded":"2024-03-19T06:39:00.716551+0000","last_fullsized":"2024-03-19T06:39:00.716551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:39:00.716202+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:39:00.716202+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.716202+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:44:36.922617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"32'16","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:50.703020+0000","last_change":"2024-03-19T06:38:50.703020+0000","last_active":"2024-03-19T06:38:50.703020+0000","last_peered":"2024-03-19T06:38:50.703020+0000","last_clean":"2024-03-19T06:38:50.703020+0000","last_became_active":"2024-03-19T06:06:33.078125+0000","last_became_peered":"2024-03-19T06:06:33.078125+0000","last_unstale":"2024-03-19T06:38:50.703020+0000","last_undegraded":"2024-03-19T06:38:50.703020+0000","last_fullsized":"2024-03-19T06:38:50.703020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:38:50.702746+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:38:50.702746+0000","last_clean_scrub_stamp":"2024-03-19T06:38:50.702746+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:33:29.544944+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"32'61","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:10.317700+0000","last_change":"2024-03-19T06:39:10.317827+0000","last_active":"2024-03-19T06:39:10.317700+0000","last_peered":"2024-03-19T06:39:10.317700+0000","last_clean":"2024-03-19T06:39:10.317700+0000","last_became_active":"2024-03-19T06:06:42.445352+0000","last_became_peered":"2024-03-19T06:06:42.445352+0000","last_unstale":"2024-03-19T06:39:10.317700+0000","last_undegraded":"2024-03-19T06:39:10.317700+0000","last_fullsized":"2024-03-19T06:39:10.317700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-19T06:39:10.317439+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-19T06:39:10.317439+0000","last_clean_scrub_stamp":"2024-03-19T06:39:10.317439+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:37.306014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":7361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'18","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:11.487076+0000","last_change":"2024-03-19T06:39:11.487139+0000","last_active":"2024-03-19T06:39:11.487076+0000","last_peered":"2024-03-19T06:39:11.487076+0000","last_clean":"2024-03-19T06:39:11.487076+0000","last_became_active":"2024-03-19T06:06:34.596735+0000","last_became_peered":"2024-03-19T06:06:34.596735+0000","last_unstale":"2024-03-19T06:39:11.487076+0000","last_undegraded":"2024-03-19T06:39:11.487076+0000","last_fullsized":"2024-03-19T06:39:11.487076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:39:11.486842+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:39:11.486842+0000","last_clean_scrub_stamp":"2024-03-19T06:39:11.486842+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:28.002035+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"32'846","reported_seq":902,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.612106+0000","last_change":"2024-03-19T06:38:59.612106+0000","last_active":"2024-03-19T06:38:59.612106+0000","last_peered":"2024-03-19T06:38:59.612106+0000","last_clean":"2024-03-19T06:38:59.612106+0000","last_became_active":"2024-03-19T06:06:33.109560+0000","last_became_peered":"2024-03-19T06:06:33.109560+0000","last_unstale":"2024-03-19T06:38:59.612106+0000","last_undegraded":"2024-03-19T06:38:59.612106+0000","last_fullsized":"2024-03-19T06:38:59.612106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'846","last_scrub_stamp":"2024-03-19T06:38:59.611820+0000","last_deep_scrub":"32'846","last_deep_scrub_stamp":"2024-03-19T06:38:59.611820+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.611820+0000","objects_scrubbed":6,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:01:58.865684+0000","scrub_duration":36,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":839,"num_write_kb":4576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"32'84","reported_seq":127,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.504482+0000","last_change":"2024-03-19T06:39:05.504551+0000","last_active":"2024-03-19T06:39:05.504482+0000","last_peered":"2024-03-19T06:39:05.504482+0000","last_clean":"2024-03-19T06:39:05.504482+0000","last_became_active":"2024-03-19T06:06:42.173583+0000","last_became_peered":"2024-03-19T06:06:42.173583+0000","last_unstale":"2024-03-19T06:39:05.504482+0000","last_undegraded":"2024-03-19T06:39:05.504482+0000","last_fullsized":"2024-03-19T06:39:05.504482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'84","last_scrub_stamp":"2024-03-19T06:39:05.504306+0000","last_deep_scrub":"32'84","last_deep_scrub_stamp":"2024-03-19T06:39:05.504306+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.504306+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:16:18.199086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":13735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"32'24","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.312349+0000","last_change":"2024-03-19T06:38:58.312349+0000","last_active":"2024-03-19T06:38:58.312349+0000","last_peered":"2024-03-19T06:38:58.312349+0000","last_clean":"2024-03-19T06:38:58.312349+0000","last_became_active":"2024-03-19T06:06:34.591548+0000","last_became_peered":"2024-03-19T06:06:34.591548+0000","last_unstale":"2024-03-19T06:38:58.312349+0000","last_undegraded":"2024-03-19T06:38:58.312349+0000","last_fullsized":"2024-03-19T06:38:58.312349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-03-19T06:38:58.312017+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-03-19T06:38:58.312017+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.312017+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:55:57.780553+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"32'336","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.311517+0000","last_change":"2024-03-19T06:38:55.311566+0000","last_active":"2024-03-19T06:38:55.311517+0000","last_peered":"2024-03-19T06:38:55.311517+0000","last_clean":"2024-03-19T06:38:55.311517+0000","last_became_active":"2024-03-19T06:06:33.088600+0000","last_became_peered":"2024-03-19T06:06:33.088600+0000","last_unstale":"2024-03-19T06:38:55.311517+0000","last_undegraded":"2024-03-19T06:38:55.311517+0000","last_fullsized":"2024-03-19T06:38:55.311517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'336","last_scrub_stamp":"2024-03-19T06:38:55.311416+0000","last_deep_scrub":"32'336","last_deep_scrub_stamp":"2024-03-19T06:38:55.311416+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.311416+0000","objects_scrubbed":4,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:27:41.513032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":329,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'115","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.379303+0000","last_change":"2024-03-19T06:39:03.379425+0000","last_active":"2024-03-19T06:39:03.379303+0000","last_peered":"2024-03-19T06:39:03.379303+0000","last_clean":"2024-03-19T06:39:03.379303+0000","last_became_active":"2024-03-19T06:06:42.160485+0000","last_became_peered":"2024-03-19T06:06:42.160485+0000","last_unstale":"2024-03-19T06:39:03.379303+0000","last_undegraded":"2024-03-19T06:39:03.379303+0000","last_fullsized":"2024-03-19T06:39:03.379303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'115","last_scrub_stamp":"2024-03-19T06:39:03.379024+0000","last_deep_scrub":"32'115","last_deep_scrub_stamp":"2024-03-19T06:39:03.379024+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.379024+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:05:17.871504+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107,"num_write_kb":11739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'25","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.683177+0000","last_change":"2024-03-19T06:38:57.683233+0000","last_active":"2024-03-19T06:38:57.683177+0000","last_peered":"2024-03-19T06:38:57.683177+0000","last_clean":"2024-03-19T06:38:57.683177+0000","last_became_active":"2024-03-19T06:06:34.541531+0000","last_became_peered":"2024-03-19T06:06:34.541531+0000","last_unstale":"2024-03-19T06:38:57.683177+0000","last_undegraded":"2024-03-19T06:38:57.683177+0000","last_fullsized":"2024-03-19T06:38:57.683177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-03-19T06:38:57.683008+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-03-19T06:38:57.683008+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.683008+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:02:51.587150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'9","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.296440+0000","last_change":"2024-03-19T06:39:00.296509+0000","last_active":"2024-03-19T06:39:00.296440+0000","last_peered":"2024-03-19T06:39:00.296440+0000","last_clean":"2024-03-19T06:39:00.296440+0000","last_became_active":"2024-03-19T06:06:33.104926+0000","last_became_peered":"2024-03-19T06:06:33.104926+0000","last_unstale":"2024-03-19T06:39:00.296440+0000","last_undegraded":"2024-03-19T06:39:00.296440+0000","last_fullsized":"2024-03-19T06:39:00.296440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-19T06:39:00.296274+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-19T06:39:00.296274+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.296274+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:27:15.899603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"32'77","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.270621+0000","last_change":"2024-03-19T06:39:07.270748+0000","last_active":"2024-03-19T06:39:07.270621+0000","last_peered":"2024-03-19T06:39:07.270621+0000","last_clean":"2024-03-19T06:39:07.270621+0000","last_became_active":"2024-03-19T06:06:42.157731+0000","last_became_peered":"2024-03-19T06:06:42.157731+0000","last_unstale":"2024-03-19T06:39:07.270621+0000","last_undegraded":"2024-03-19T06:39:07.270621+0000","last_fullsized":"2024-03-19T06:39:07.270621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'77","last_scrub_stamp":"2024-03-19T06:39:07.270396+0000","last_deep_scrub":"32'77","last_deep_scrub_stamp":"2024-03-19T06:39:07.270396+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.270396+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:33:39.750803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":9054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"32'27","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.264554+0000","last_change":"2024-03-19T06:39:07.264618+0000","last_active":"2024-03-19T06:39:07.264554+0000","last_peered":"2024-03-19T06:39:07.264554+0000","last_clean":"2024-03-19T06:39:07.264554+0000","last_became_active":"2024-03-19T06:06:34.588203+0000","last_became_peered":"2024-03-19T06:06:34.588203+0000","last_unstale":"2024-03-19T06:39:07.264554+0000","last_undegraded":"2024-03-19T06:39:07.264554+0000","last_fullsized":"2024-03-19T06:39:07.264554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:39:07.264373+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:39:07.264373+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.264373+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:34:23.779566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"32'16","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.586499+0000","last_change":"2024-03-19T06:38:57.586621+0000","last_active":"2024-03-19T06:38:57.586499+0000","last_peered":"2024-03-19T06:38:57.586499+0000","last_clean":"2024-03-19T06:38:57.586499+0000","last_became_active":"2024-03-19T06:06:33.108406+0000","last_became_peered":"2024-03-19T06:06:33.108406+0000","last_unstale":"2024-03-19T06:38:57.586499+0000","last_undegraded":"2024-03-19T06:38:57.586499+0000","last_fullsized":"2024-03-19T06:38:57.586499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-03-19T06:38:57.586296+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-03-19T06:38:57.586296+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.586296+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:31.938486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"32'86","reported_seq":129,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:10.298654+0000","last_change":"2024-03-19T06:39:10.298837+0000","last_active":"2024-03-19T06:39:10.298654+0000","last_peered":"2024-03-19T06:39:10.298654+0000","last_clean":"2024-03-19T06:39:10.298654+0000","last_became_active":"2024-03-19T06:06:42.452394+0000","last_became_peered":"2024-03-19T06:06:42.452394+0000","last_unstale":"2024-03-19T06:39:10.298654+0000","last_undegraded":"2024-03-19T06:39:10.298654+0000","last_fullsized":"2024-03-19T06:39:10.298654+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'86","last_scrub_stamp":"2024-03-19T06:39:10.298446+0000","last_deep_scrub":"32'86","last_deep_scrub_stamp":"2024-03-19T06:39:10.298446+0000","last_clean_scrub_stamp":"2024-03-19T06:39:10.298446+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:13:42.705896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":9535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"32'52","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.722375+0000","last_change":"2024-03-19T06:39:04.722494+0000","last_active":"2024-03-19T06:39:04.722375+0000","last_peered":"2024-03-19T06:39:04.722375+0000","last_clean":"2024-03-19T06:39:04.722375+0000","last_became_active":"2024-03-19T06:06:42.449273+0000","last_became_peered":"2024-03-19T06:06:42.449273+0000","last_unstale":"2024-03-19T06:39:04.722375+0000","last_undegraded":"2024-03-19T06:39:04.722375+0000","last_fullsized":"2024-03-19T06:39:04.722375+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'52","last_scrub_stamp":"2024-03-19T06:39:04.722122+0000","last_deep_scrub":"32'52","last_deep_scrub_stamp":"2024-03-19T06:39:04.722122+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.722122+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:12:03.825182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":3557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'27","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.325110+0000","last_change":"2024-03-19T06:38:58.325219+0000","last_active":"2024-03-19T06:38:58.325110+0000","last_peered":"2024-03-19T06:38:58.325110+0000","last_clean":"2024-03-19T06:38:58.325110+0000","last_became_active":"2024-03-19T06:06:34.583470+0000","last_became_peered":"2024-03-19T06:06:34.583470+0000","last_unstale":"2024-03-19T06:38:58.325110+0000","last_undegraded":"2024-03-19T06:38:58.325110+0000","last_fullsized":"2024-03-19T06:38:58.325110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:38:58.324919+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:38:58.324919+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.324919+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:15:14.964982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.263879+0000","last_change":"2024-03-19T06:38:58.263950+0000","last_active":"2024-03-19T06:38:58.263879+0000","last_peered":"2024-03-19T06:38:58.263879+0000","last_clean":"2024-03-19T06:38:58.263879+0000","last_became_active":"2024-03-19T06:06:33.095302+0000","last_became_peered":"2024-03-19T06:06:33.095302+0000","last_unstale":"2024-03-19T06:38:58.263879+0000","last_undegraded":"2024-03-19T06:38:58.263879+0000","last_fullsized":"2024-03-19T06:38:58.263879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-19T06:38:58.263708+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-19T06:38:58.263708+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.263708+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:52:36.833969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"32'66","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:08.562784+0000","last_change":"2024-03-19T06:39:08.562850+0000","last_active":"2024-03-19T06:39:08.562784+0000","last_peered":"2024-03-19T06:39:08.562784+0000","last_clean":"2024-03-19T06:39:08.562784+0000","last_became_active":"2024-03-19T06:06:42.172800+0000","last_became_peered":"2024-03-19T06:06:42.172800+0000","last_unstale":"2024-03-19T06:39:08.562784+0000","last_undegraded":"2024-03-19T06:39:08.562784+0000","last_fullsized":"2024-03-19T06:39:08.562784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'66","last_scrub_stamp":"2024-03-19T06:39:08.562594+0000","last_deep_scrub":"32'66","last_deep_scrub_stamp":"2024-03-19T06:39:08.562594+0000","last_clean_scrub_stamp":"2024-03-19T06:39:08.562594+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:54:02.879014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":8333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"32'26","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.269046+0000","last_change":"2024-03-19T06:39:00.269104+0000","last_active":"2024-03-19T06:39:00.269046+0000","last_peered":"2024-03-19T06:39:00.269046+0000","last_clean":"2024-03-19T06:39:00.269046+0000","last_became_active":"2024-03-19T06:06:34.318214+0000","last_became_peered":"2024-03-19T06:06:34.318214+0000","last_unstale":"2024-03-19T06:39:00.269046+0000","last_undegraded":"2024-03-19T06:39:00.269046+0000","last_fullsized":"2024-03-19T06:39:00.269046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-03-19T06:39:00.268872+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-03-19T06:39:00.268872+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.268872+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:04:14.008744+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.253663+0000","last_change":"2024-03-19T06:38:59.253737+0000","last_active":"2024-03-19T06:38:59.253663+0000","last_peered":"2024-03-19T06:38:59.253663+0000","last_clean":"2024-03-19T06:38:59.253663+0000","last_became_active":"2024-03-19T06:06:33.106427+0000","last_became_peered":"2024-03-19T06:06:33.106427+0000","last_unstale":"2024-03-19T06:38:59.253663+0000","last_undegraded":"2024-03-19T06:38:59.253663+0000","last_fullsized":"2024-03-19T06:38:59.253663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-19T06:38:59.253491+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-19T06:38:59.253491+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.253491+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:51:36.293576+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"32'433","reported_seq":488,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.597241+0000","last_change":"2024-03-19T06:39:00.597241+0000","last_active":"2024-03-19T06:39:00.597241+0000","last_peered":"2024-03-19T06:39:00.597241+0000","last_clean":"2024-03-19T06:39:00.597241+0000","last_became_active":"2024-03-19T06:06:33.110625+0000","last_became_peered":"2024-03-19T06:06:33.110625+0000","last_unstale":"2024-03-19T06:39:00.597241+0000","last_undegraded":"2024-03-19T06:39:00.597241+0000","last_fullsized":"2024-03-19T06:39:00.597241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'433","last_scrub_stamp":"2024-03-19T06:39:00.596854+0000","last_deep_scrub":"32'433","last_deep_scrub_stamp":"2024-03-19T06:39:00.596854+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.596854+0000","objects_scrubbed":4,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:35:11.107879+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"32'23","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.639127+0000","last_change":"2024-03-19T06:38:54.639127+0000","last_active":"2024-03-19T06:38:54.639127+0000","last_peered":"2024-03-19T06:38:54.639127+0000","last_clean":"2024-03-19T06:38:54.639127+0000","last_became_active":"2024-03-19T06:06:34.340083+0000","last_became_peered":"2024-03-19T06:06:34.340083+0000","last_unstale":"2024-03-19T06:38:54.639127+0000","last_undegraded":"2024-03-19T06:38:54.639127+0000","last_fullsized":"2024-03-19T06:38:54.639127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-19T06:38:54.639016+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-19T06:38:54.639016+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.639016+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:45:07.001544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"32'57","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:57.492086+0000","last_change":"2024-03-19T06:38:57.492086+0000","last_active":"2024-03-19T06:38:57.492086+0000","last_peered":"2024-03-19T06:38:57.492086+0000","last_clean":"2024-03-19T06:38:57.492086+0000","last_became_active":"2024-03-19T06:06:42.145989+0000","last_became_peered":"2024-03-19T06:06:42.145989+0000","last_unstale":"2024-03-19T06:38:57.492086+0000","last_undegraded":"2024-03-19T06:38:57.492086+0000","last_fullsized":"2024-03-19T06:38:57.492086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'57","last_scrub_stamp":"2024-03-19T06:38:57.491740+0000","last_deep_scrub":"32'57","last_deep_scrub_stamp":"2024-03-19T06:38:57.491740+0000","last_clean_scrub_stamp":"2024-03-19T06:38:57.491740+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:07:56.509873+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'547","reported_seq":602,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.276926+0000","last_change":"2024-03-19T06:38:58.276926+0000","last_active":"2024-03-19T06:38:58.276926+0000","last_peered":"2024-03-19T06:38:58.276926+0000","last_clean":"2024-03-19T06:38:58.276926+0000","last_became_active":"2024-03-19T06:06:33.096929+0000","last_became_peered":"2024-03-19T06:06:33.096929+0000","last_unstale":"2024-03-19T06:38:58.276926+0000","last_undegraded":"2024-03-19T06:38:58.276926+0000","last_fullsized":"2024-03-19T06:38:58.276926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'547","last_scrub_stamp":"2024-03-19T06:38:58.276643+0000","last_deep_scrub":"32'547","last_deep_scrub_stamp":"2024-03-19T06:38:58.276643+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.276643+0000","objects_scrubbed":3,"log_size":547,"log_dups_size":0,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:59:33.591603+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":539,"num_write_kb":4375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"32'22","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.347920+0000","last_change":"2024-03-19T06:38:59.347920+0000","last_active":"2024-03-19T06:38:59.347920+0000","last_peered":"2024-03-19T06:38:59.347920+0000","last_clean":"2024-03-19T06:38:59.347920+0000","last_became_active":"2024-03-19T06:06:34.592734+0000","last_became_peered":"2024-03-19T06:06:34.592734+0000","last_unstale":"2024-03-19T06:38:59.347920+0000","last_undegraded":"2024-03-19T06:38:59.347920+0000","last_fullsized":"2024-03-19T06:38:59.347920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:38:59.347687+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:38:59.347687+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.347687+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:51:36.047453+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'76","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.312771+0000","last_change":"2024-03-19T06:39:06.312771+0000","last_active":"2024-03-19T06:39:06.312771+0000","last_peered":"2024-03-19T06:39:06.312771+0000","last_clean":"2024-03-19T06:39:06.312771+0000","last_became_active":"2024-03-19T06:06:42.104937+0000","last_became_peered":"2024-03-19T06:06:42.104937+0000","last_unstale":"2024-03-19T06:39:06.312771+0000","last_undegraded":"2024-03-19T06:39:06.312771+0000","last_fullsized":"2024-03-19T06:39:06.312771+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'76","last_scrub_stamp":"2024-03-19T06:39:06.312427+0000","last_deep_scrub":"32'76","last_deep_scrub_stamp":"2024-03-19T06:39:06.312427+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.312427+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:07:05.745050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":5396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"32'30","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:01.561434+0000","last_change":"2024-03-19T06:39:01.561498+0000","last_active":"2024-03-19T06:39:01.561434+0000","last_peered":"2024-03-19T06:39:01.561434+0000","last_clean":"2024-03-19T06:39:01.561434+0000","last_became_active":"2024-03-19T06:06:34.330166+0000","last_became_peered":"2024-03-19T06:06:34.330166+0000","last_unstale":"2024-03-19T06:39:01.561434+0000","last_undegraded":"2024-03-19T06:39:01.561434+0000","last_fullsized":"2024-03-19T06:39:01.561434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-03-19T06:39:01.561248+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-03-19T06:39:01.561248+0000","last_clean_scrub_stamp":"2024-03-19T06:39:01.561248+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:27:43.103684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"32'25","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.520037+0000","last_change":"2024-03-19T06:38:56.520168+0000","last_active":"2024-03-19T06:38:56.520037+0000","last_peered":"2024-03-19T06:38:56.520037+0000","last_clean":"2024-03-19T06:38:56.520037+0000","last_became_active":"2024-03-19T06:06:34.543723+0000","last_became_peered":"2024-03-19T06:06:34.543723+0000","last_unstale":"2024-03-19T06:38:56.520037+0000","last_undegraded":"2024-03-19T06:38:56.520037+0000","last_fullsized":"2024-03-19T06:38:56.520037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-03-19T06:38:56.519673+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-03-19T06:38:56.519673+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.519673+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:08:36.026663+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'25","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:58.529477+0000","last_change":"2024-03-19T06:38:58.529526+0000","last_active":"2024-03-19T06:38:58.529477+0000","last_peered":"2024-03-19T06:38:58.529477+0000","last_clean":"2024-03-19T06:38:58.529477+0000","last_became_active":"2024-03-19T06:07:02.003213+0000","last_became_peered":"2024-03-19T06:07:02.003213+0000","last_unstale":"2024-03-19T06:38:58.529477+0000","last_undegraded":"2024-03-19T06:38:58.529477+0000","last_fullsized":"2024-03-19T06:38:58.529477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'25","last_scrub_stamp":"2024-03-19T06:38:58.529362+0000","last_deep_scrub":"32'25","last_deep_scrub_stamp":"2024-03-19T06:38:58.529362+0000","last_clean_scrub_stamp":"2024-03-19T06:38:58.529362+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:27:59.639016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'18","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:52.712355+0000","last_change":"2024-03-19T06:38:52.712393+0000","last_active":"2024-03-19T06:38:52.712355+0000","last_peered":"2024-03-19T06:38:52.712355+0000","last_clean":"2024-03-19T06:38:52.712355+0000","last_became_active":"2024-03-19T06:06:34.321014+0000","last_became_peered":"2024-03-19T06:06:34.321014+0000","last_unstale":"2024-03-19T06:38:52.712355+0000","last_undegraded":"2024-03-19T06:38:52.712355+0000","last_fullsized":"2024-03-19T06:38:52.712355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:52.712243+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:52.712243+0000","last_clean_scrub_stamp":"2024-03-19T06:38:52.712243+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T09:02:51.210372+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'17","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:03.288036+0000","last_change":"2024-03-19T06:39:03.288036+0000","last_active":"2024-03-19T06:39:03.288036+0000","last_peered":"2024-03-19T06:39:03.288036+0000","last_clean":"2024-03-19T06:39:03.288036+0000","last_became_active":"2024-03-19T06:06:34.341062+0000","last_became_peered":"2024-03-19T06:06:34.341062+0000","last_unstale":"2024-03-19T06:39:03.288036+0000","last_undegraded":"2024-03-19T06:39:03.288036+0000","last_fullsized":"2024-03-19T06:39:03.288036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:39:03.287635+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:39:03.287635+0000","last_clean_scrub_stamp":"2024-03-19T06:39:03.287635+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:13.601067+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:50.334479+0000","last_change":"2024-03-19T06:38:50.334479+0000","last_active":"2024-03-19T06:38:50.334479+0000","last_peered":"2024-03-19T06:38:50.334479+0000","last_clean":"2024-03-19T06:38:50.334479+0000","last_became_active":"2024-03-19T06:06:34.587467+0000","last_became_peered":"2024-03-19T06:06:34.587467+0000","last_unstale":"2024-03-19T06:38:50.334479+0000","last_undegraded":"2024-03-19T06:38:50.334479+0000","last_fullsized":"2024-03-19T06:38:50.334479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:50.334362+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:50.334362+0000","last_clean_scrub_stamp":"2024-03-19T06:38:50.334362+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T11:33:29.176560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.512641+0000","last_change":"2024-03-19T06:39:07.512748+0000","last_active":"2024-03-19T06:39:07.512641+0000","last_peered":"2024-03-19T06:39:07.512641+0000","last_clean":"2024-03-19T06:39:07.512641+0000","last_became_active":"2024-03-19T06:06:34.588847+0000","last_became_peered":"2024-03-19T06:06:34.588847+0000","last_unstale":"2024-03-19T06:39:07.512641+0000","last_undegraded":"2024-03-19T06:39:07.512641+0000","last_fullsized":"2024-03-19T06:39:07.512641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-19T06:39:07.512431+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-19T06:39:07.512431+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.512431+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:21:54.888730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"32'15","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.263975+0000","last_change":"2024-03-19T06:38:56.263975+0000","last_active":"2024-03-19T06:38:56.263975+0000","last_peered":"2024-03-19T06:38:56.263975+0000","last_clean":"2024-03-19T06:38:56.263975+0000","last_became_active":"2024-03-19T06:06:34.345834+0000","last_became_peered":"2024-03-19T06:06:34.345834+0000","last_unstale":"2024-03-19T06:38:56.263975+0000","last_undegraded":"2024-03-19T06:38:56.263975+0000","last_fullsized":"2024-03-19T06:38:56.263975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-19T06:38:56.263715+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-19T06:38:56.263715+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.263715+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:39:23.570450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.280453+0000","last_change":"2024-03-19T06:39:05.280453+0000","last_active":"2024-03-19T06:39:05.280453+0000","last_peered":"2024-03-19T06:39:05.280453+0000","last_clean":"2024-03-19T06:39:05.280453+0000","last_became_active":"2024-03-19T06:06:34.540643+0000","last_became_peered":"2024-03-19T06:06:34.540643+0000","last_unstale":"2024-03-19T06:39:05.280453+0000","last_undegraded":"2024-03-19T06:39:05.280453+0000","last_fullsized":"2024-03-19T06:39:05.280453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:39:05.280206+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:39:05.280206+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.280206+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:51:42.320291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'30","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.246845+0000","last_change":"2024-03-19T06:39:04.246906+0000","last_active":"2024-03-19T06:39:04.246845+0000","last_peered":"2024-03-19T06:39:04.246845+0000","last_clean":"2024-03-19T06:39:04.246845+0000","last_became_active":"2024-03-19T06:06:34.341144+0000","last_became_peered":"2024-03-19T06:06:34.341144+0000","last_unstale":"2024-03-19T06:39:04.246845+0000","last_undegraded":"2024-03-19T06:39:04.246845+0000","last_fullsized":"2024-03-19T06:39:04.246845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-03-19T06:39:04.246638+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-03-19T06:39:04.246638+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.246638+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T16:04:31.235213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'24","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:08.280158+0000","last_change":"2024-03-19T06:39:08.280220+0000","last_active":"2024-03-19T06:39:08.280158+0000","last_peered":"2024-03-19T06:39:08.280158+0000","last_clean":"2024-03-19T06:39:08.280158+0000","last_became_active":"2024-03-19T06:06:34.597628+0000","last_became_peered":"2024-03-19T06:06:34.597628+0000","last_unstale":"2024-03-19T06:39:08.280158+0000","last_undegraded":"2024-03-19T06:39:08.280158+0000","last_fullsized":"2024-03-19T06:39:08.280158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-03-19T06:39:08.279963+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-03-19T06:39:08.279963+0000","last_clean_scrub_stamp":"2024-03-19T06:39:08.279963+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:51:27.817369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"32'30","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.709716+0000","last_change":"2024-03-19T06:38:59.709865+0000","last_active":"2024-03-19T06:38:59.709716+0000","last_peered":"2024-03-19T06:38:59.709716+0000","last_clean":"2024-03-19T06:38:59.709716+0000","last_became_active":"2024-03-19T06:06:34.591172+0000","last_became_peered":"2024-03-19T06:06:34.591172+0000","last_unstale":"2024-03-19T06:38:59.709716+0000","last_undegraded":"2024-03-19T06:38:59.709716+0000","last_fullsized":"2024-03-19T06:38:59.709716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'30","last_scrub_stamp":"2024-03-19T06:38:59.709504+0000","last_deep_scrub":"32'30","last_deep_scrub_stamp":"2024-03-19T06:38:59.709504+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.709504+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:27:47.208333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"32'27","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.527550+0000","last_change":"2024-03-19T06:39:04.527612+0000","last_active":"2024-03-19T06:39:04.527550+0000","last_peered":"2024-03-19T06:39:04.527550+0000","last_clean":"2024-03-19T06:39:04.527550+0000","last_became_active":"2024-03-19T06:06:34.346000+0000","last_became_peered":"2024-03-19T06:06:34.346000+0000","last_unstale":"2024-03-19T06:39:04.527550+0000","last_undegraded":"2024-03-19T06:39:04.527550+0000","last_fullsized":"2024-03-19T06:39:04.527550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'27","last_scrub_stamp":"2024-03-19T06:39:04.527375+0000","last_deep_scrub":"32'27","last_deep_scrub_stamp":"2024-03-19T06:39:04.527375+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.527375+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:08:36.693486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"32'22","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:08.406906+0000","last_change":"2024-03-19T06:39:08.406964+0000","last_active":"2024-03-19T06:39:08.406906+0000","last_peered":"2024-03-19T06:39:08.406906+0000","last_clean":"2024-03-19T06:39:08.406906+0000","last_became_active":"2024-03-19T06:06:34.595019+0000","last_became_peered":"2024-03-19T06:06:34.595019+0000","last_unstale":"2024-03-19T06:39:08.406906+0000","last_undegraded":"2024-03-19T06:39:08.406906+0000","last_fullsized":"2024-03-19T06:39:08.406906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:08.406725+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:08.406725+0000","last_clean_scrub_stamp":"2024-03-19T06:39:08.406725+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:59:43.721684+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"32'32","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.558589+0000","last_change":"2024-03-19T06:38:55.558589+0000","last_active":"2024-03-19T06:38:55.558589+0000","last_peered":"2024-03-19T06:38:55.558589+0000","last_clean":"2024-03-19T06:38:55.558589+0000","last_became_active":"2024-03-19T06:06:34.523523+0000","last_became_peered":"2024-03-19T06:06:34.523523+0000","last_unstale":"2024-03-19T06:38:55.558589+0000","last_undegraded":"2024-03-19T06:38:55.558589+0000","last_fullsized":"2024-03-19T06:38:55.558589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'32","last_scrub_stamp":"2024-03-19T06:38:55.558372+0000","last_deep_scrub":"32'32","last_deep_scrub_stamp":"2024-03-19T06:38:55.558372+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.558372+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:54:05.219255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"32'22","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:09.306409+0000","last_change":"2024-03-19T06:39:09.306409+0000","last_active":"2024-03-19T06:39:09.306409+0000","last_peered":"2024-03-19T06:39:09.306409+0000","last_clean":"2024-03-19T06:39:09.306409+0000","last_became_active":"2024-03-19T06:06:34.598087+0000","last_became_peered":"2024-03-19T06:06:34.598087+0000","last_unstale":"2024-03-19T06:39:09.306409+0000","last_undegraded":"2024-03-19T06:39:09.306409+0000","last_fullsized":"2024-03-19T06:39:09.306409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:09.306171+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:09.306171+0000","last_clean_scrub_stamp":"2024-03-19T06:39:09.306171+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T13:30:19.619604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"32'26","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.275482+0000","last_change":"2024-03-19T06:39:06.275482+0000","last_active":"2024-03-19T06:39:06.275482+0000","last_peered":"2024-03-19T06:39:06.275482+0000","last_clean":"2024-03-19T06:39:06.275482+0000","last_became_active":"2024-03-19T06:06:34.541340+0000","last_became_peered":"2024-03-19T06:06:34.541340+0000","last_unstale":"2024-03-19T06:39:06.275482+0000","last_undegraded":"2024-03-19T06:39:06.275482+0000","last_fullsized":"2024-03-19T06:39:06.275482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-03-19T06:39:06.275250+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-03-19T06:39:06.275250+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.275250+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:04:20.015122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"32'28","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.364167+0000","last_change":"2024-03-19T06:38:59.364167+0000","last_active":"2024-03-19T06:38:59.364167+0000","last_peered":"2024-03-19T06:38:59.364167+0000","last_clean":"2024-03-19T06:38:59.364167+0000","last_became_active":"2024-03-19T06:06:34.583210+0000","last_became_peered":"2024-03-19T06:06:34.583210+0000","last_unstale":"2024-03-19T06:38:59.364167+0000","last_undegraded":"2024-03-19T06:38:59.364167+0000","last_fullsized":"2024-03-19T06:38:59.364167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-19T06:38:59.363919+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-19T06:38:59.363919+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.363919+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:27:46.862749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'26","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:49.711466+0000","last_change":"2024-03-19T06:38:49.711526+0000","last_active":"2024-03-19T06:38:49.711466+0000","last_peered":"2024-03-19T06:38:49.711466+0000","last_clean":"2024-03-19T06:38:49.711466+0000","last_became_active":"2024-03-19T06:06:34.585812+0000","last_became_peered":"2024-03-19T06:06:34.585812+0000","last_unstale":"2024-03-19T06:38:49.711466+0000","last_undegraded":"2024-03-19T06:38:49.711466+0000","last_fullsized":"2024-03-19T06:38:49.711466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-03-19T06:38:49.711300+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-03-19T06:38:49.711300+0000","last_clean_scrub_stamp":"2024-03-19T06:38:49.711300+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:36:04.928016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'33","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:07.532527+0000","last_change":"2024-03-19T06:39:07.532592+0000","last_active":"2024-03-19T06:39:07.532527+0000","last_peered":"2024-03-19T06:39:07.532527+0000","last_clean":"2024-03-19T06:39:07.532527+0000","last_became_active":"2024-03-19T06:07:02.157584+0000","last_became_peered":"2024-03-19T06:07:02.157584+0000","last_unstale":"2024-03-19T06:39:07.532527+0000","last_undegraded":"2024-03-19T06:39:07.532527+0000","last_fullsized":"2024-03-19T06:39:07.532527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'33","last_scrub_stamp":"2024-03-19T06:39:07.532358+0000","last_deep_scrub":"32'33","last_deep_scrub_stamp":"2024-03-19T06:39:07.532358+0000","last_clean_scrub_stamp":"2024-03-19T06:39:07.532358+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:18:08.824235+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.34","version":"32'17","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:56.315809+0000","last_change":"2024-03-19T06:38:56.315868+0000","last_active":"2024-03-19T06:38:56.315809+0000","last_peered":"2024-03-19T06:38:56.315809+0000","last_clean":"2024-03-19T06:38:56.315809+0000","last_became_active":"2024-03-19T06:06:34.350938+0000","last_became_peered":"2024-03-19T06:06:34.350938+0000","last_unstale":"2024-03-19T06:38:56.315809+0000","last_undegraded":"2024-03-19T06:38:56.315809+0000","last_fullsized":"2024-03-19T06:38:56.315809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:38:56.315634+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:38:56.315634+0000","last_clean_scrub_stamp":"2024-03-19T06:38:56.315634+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:56:19.073701+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'22","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:05.514618+0000","last_change":"2024-03-19T06:39:05.514673+0000","last_active":"2024-03-19T06:39:05.514618+0000","last_peered":"2024-03-19T06:39:05.514618+0000","last_clean":"2024-03-19T06:39:05.514618+0000","last_became_active":"2024-03-19T06:06:34.538423+0000","last_became_peered":"2024-03-19T06:06:34.538423+0000","last_unstale":"2024-03-19T06:39:05.514618+0000","last_undegraded":"2024-03-19T06:39:05.514618+0000","last_fullsized":"2024-03-19T06:39:05.514618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:05.514480+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:05.514480+0000","last_clean_scrub_stamp":"2024-03-19T06:39:05.514480+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:25:11.402705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.469707+0000","last_change":"2024-03-19T06:39:06.469820+0000","last_active":"2024-03-19T06:39:06.469707+0000","last_peered":"2024-03-19T06:39:06.469707+0000","last_clean":"2024-03-19T06:39:06.469707+0000","last_became_active":"2024-03-19T06:06:34.543297+0000","last_became_peered":"2024-03-19T06:06:34.543297+0000","last_unstale":"2024-03-19T06:39:06.469707+0000","last_undegraded":"2024-03-19T06:39:06.469707+0000","last_fullsized":"2024-03-19T06:39:06.469707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-03-19T06:39:06.469486+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-03-19T06:39:06.469486+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.469486+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:20:40.655494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:10.475296+0000","last_change":"2024-03-19T06:39:10.475354+0000","last_active":"2024-03-19T06:39:10.475296+0000","last_peered":"2024-03-19T06:39:10.475296+0000","last_clean":"2024-03-19T06:39:10.475296+0000","last_became_active":"2024-03-19T06:06:34.597093+0000","last_became_peered":"2024-03-19T06:06:34.597093+0000","last_unstale":"2024-03-19T06:39:10.475296+0000","last_undegraded":"2024-03-19T06:39:10.475296+0000","last_fullsized":"2024-03-19T06:39:10.475296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-19T06:39:10.475123+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-19T06:39:10.475123+0000","last_clean_scrub_stamp":"2024-03-19T06:39:10.475123+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T17:04:24.214995+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"32'18","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:54.304279+0000","last_change":"2024-03-19T06:38:54.304279+0000","last_active":"2024-03-19T06:38:54.304279+0000","last_peered":"2024-03-19T06:38:54.304279+0000","last_clean":"2024-03-19T06:38:54.304279+0000","last_became_active":"2024-03-19T06:06:34.541670+0000","last_became_peered":"2024-03-19T06:06:34.541670+0000","last_unstale":"2024-03-19T06:38:54.304279+0000","last_undegraded":"2024-03-19T06:38:54.304279+0000","last_fullsized":"2024-03-19T06:38:54.304279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:38:54.304181+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:38:54.304181+0000","last_clean_scrub_stamp":"2024-03-19T06:38:54.304181+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:41:49.703236+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'17","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:09.441675+0000","last_change":"2024-03-19T06:39:09.441733+0000","last_active":"2024-03-19T06:39:09.441675+0000","last_peered":"2024-03-19T06:39:09.441675+0000","last_clean":"2024-03-19T06:39:09.441675+0000","last_became_active":"2024-03-19T06:06:34.596216+0000","last_became_peered":"2024-03-19T06:06:34.596216+0000","last_unstale":"2024-03-19T06:39:09.441675+0000","last_undegraded":"2024-03-19T06:39:09.441675+0000","last_fullsized":"2024-03-19T06:39:09.441675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'17","last_scrub_stamp":"2024-03-19T06:39:09.441511+0000","last_deep_scrub":"32'17","last_deep_scrub_stamp":"2024-03-19T06:39:09.441511+0000","last_clean_scrub_stamp":"2024-03-19T06:39:09.441511+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T15:51:46.481597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'26","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:59.554912+0000","last_change":"2024-03-19T06:38:59.554975+0000","last_active":"2024-03-19T06:38:59.554912+0000","last_peered":"2024-03-19T06:38:59.554912+0000","last_clean":"2024-03-19T06:38:59.554912+0000","last_became_active":"2024-03-19T06:07:02.045169+0000","last_became_peered":"2024-03-19T06:07:02.045169+0000","last_unstale":"2024-03-19T06:38:59.554912+0000","last_undegraded":"2024-03-19T06:38:59.554912+0000","last_fullsized":"2024-03-19T06:38:59.554912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'26","last_scrub_stamp":"2024-03-19T06:38:59.554701+0000","last_deep_scrub":"32'26","last_deep_scrub_stamp":"2024-03-19T06:38:59.554701+0000","last_clean_scrub_stamp":"2024-03-19T06:38:59.554701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T07:52:18.410566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"32'22","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:06.434691+0000","last_change":"2024-03-19T06:39:06.434691+0000","last_active":"2024-03-19T06:39:06.434691+0000","last_peered":"2024-03-19T06:39:06.434691+0000","last_clean":"2024-03-19T06:39:06.434691+0000","last_became_active":"2024-03-19T06:06:34.591771+0000","last_became_peered":"2024-03-19T06:06:34.591771+0000","last_unstale":"2024-03-19T06:39:06.434691+0000","last_undegraded":"2024-03-19T06:39:06.434691+0000","last_fullsized":"2024-03-19T06:39:06.434691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'22","last_scrub_stamp":"2024-03-19T06:39:06.434403+0000","last_deep_scrub":"32'22","last_deep_scrub_stamp":"2024-03-19T06:39:06.434403+0000","last_clean_scrub_stamp":"2024-03-19T06:39:06.434403+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:05:54.937670+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"32'18","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:04.284139+0000","last_change":"2024-03-19T06:39:04.284205+0000","last_active":"2024-03-19T06:39:04.284139+0000","last_peered":"2024-03-19T06:39:04.284139+0000","last_clean":"2024-03-19T06:39:04.284139+0000","last_became_active":"2024-03-19T06:06:34.538888+0000","last_became_peered":"2024-03-19T06:06:34.538888+0000","last_unstale":"2024-03-19T06:39:04.284139+0000","last_undegraded":"2024-03-19T06:39:04.284139+0000","last_fullsized":"2024-03-19T06:39:04.284139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-19T06:39:04.283940+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-19T06:39:04.283940+0000","last_clean_scrub_stamp":"2024-03-19T06:39:04.283940+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:43:38.271943+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"32'24","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:55.658421+0000","last_change":"2024-03-19T06:38:55.658482+0000","last_active":"2024-03-19T06:38:55.658421+0000","last_peered":"2024-03-19T06:38:55.658421+0000","last_clean":"2024-03-19T06:38:55.658421+0000","last_became_active":"2024-03-19T06:06:34.522719+0000","last_became_peered":"2024-03-19T06:06:34.522719+0000","last_unstale":"2024-03-19T06:38:55.658421+0000","last_undegraded":"2024-03-19T06:38:55.658421+0000","last_fullsized":"2024-03-19T06:38:55.658421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'24","last_scrub_stamp":"2024-03-19T06:38:55.658241+0000","last_deep_scrub":"32'24","last_deep_scrub_stamp":"2024-03-19T06:38:55.658241+0000","last_clean_scrub_stamp":"2024-03-19T06:38:55.658241+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T10:27:41.859857+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'19","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:38:51.339175+0000","last_change":"2024-03-19T06:38:51.339286+0000","last_active":"2024-03-19T06:38:51.339175+0000","last_peered":"2024-03-19T06:38:51.339175+0000","last_clean":"2024-03-19T06:38:51.339175+0000","last_became_active":"2024-03-19T06:06:34.587263+0000","last_became_peered":"2024-03-19T06:06:34.587263+0000","last_unstale":"2024-03-19T06:38:51.339175+0000","last_undegraded":"2024-03-19T06:38:51.339175+0000","last_fullsized":"2024-03-19T06:38:51.339175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:38:51.338867+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:38:51.338867+0000","last_clean_scrub_stamp":"2024-03-19T06:38:51.338867+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T12:50:56.786904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"32'19","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-19T06:39:00.544771+0000","last_change":"2024-03-19T06:39:00.544861+0000","last_active":"2024-03-19T06:39:00.544771+0000","last_peered":"2024-03-19T06:39:00.544771+0000","last_clean":"2024-03-19T06:39:00.544771+0000","last_became_active":"2024-03-19T06:07:02.157691+0000","last_became_peered":"2024-03-19T06:07:02.157691+0000","last_unstale":"2024-03-19T06:39:00.544771+0000","last_undegraded":"2024-03-19T06:39:00.544771+0000","last_fullsized":"2024-03-19T06:39:00.544771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'19","last_scrub_stamp":"2024-03-19T06:39:00.544585+0000","last_deep_scrub":"32'19","last_deep_scrub_stamp":"2024-03-19T06:39:00.544585+0000","last_clean_scrub_stamp":"2024-03-19T06:39:00.544585+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T14:36:20.278493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2145,"num_write_kb":250125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2307,"ondisk_log_size":2307,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1476,"ondisk_log_size":1476,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22012001,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":481,"num_read_kb":511,"num_write":7122,"num_write_kb":24983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":44269568,"data_stored":44024002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5597,"ondisk_log_size":5597,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477140,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44412,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327428,"statfs":{"total":96636764160,"available":96591286272,"internally_reserved":0,"allocated":13553664,"data_stored":13317561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719477139,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39876,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331964,"statfs":{"total":96636764160,"available":96595931136,"internally_reserved":0,"allocated":389120,"data_stored":146113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719477138,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":8753152,"data_stored":8532119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":16,"seq":68719477138,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44900,"kb_used_data":9564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326940,"statfs":{"total":96636764160,"available":96590786560,"internally_reserved":0,"allocated":9793536,"data_stored":9563926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509842,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39724,"kb_used_data":8548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332116,"statfs":{"total":96636764160,"available":96596086784,"internally_reserved":0,"allocated":8753152,"data_stored":8532251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509842,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":491520,"data_stored":260733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509842,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":368640,"data_stored":143131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509842,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49588,"kb_used_data":5932,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94322252,"statfs":{"total":96636764160,"available":96585986048,"internally_reserved":0,"allocated":6074368,"data_stored":5841696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5140480,"data_stored":5109729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":119134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9453568,"data_stored":9422327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8413184,"data_stored":8390652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12619776,"data_stored":12585594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-19T06:39:19.601 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-19T06:39:19.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.864+0000 7fcaf3000640 1 Processor -- start 2024-03-19T06:39:19.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.864+0000 7fcaf3000640 1 -- start start 2024-03-19T06:39:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.866+0000 7fcaf3000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcaec151f30 0x7fcaec06e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.866+0000 7fcaf3000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec157b60 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.866+0000 7fcaf3000640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec157e40 con 0x7fcaec0c4bd0 2024-03-19T06:39:19.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.866+0000 7fcaf3000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaec158120 con 0x7fcaec151f30 2024-03-19T06:39:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.868+0000 7fcaf1200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcaec0c4fb0 0x7fcaec151820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59154/0 (socket says 172.21.15.17:59154) 2024-03-19T06:39:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.868+0000 7fcaf1200640 1 -- 172.21.15.17:0/1207833122 learned_addr learned my addr 172.21.15.17:0/1207833122 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:39:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.872+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654869843 0 0) 0x7fcaec157b60 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.872+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad4003520 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273232008 0 0) 0x7fcad4003520 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 >> v2:172.21.15.153:3300/0 conn(0x7fcaec151f30 msgr2=0x7fcaec06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 --2- 172.21.15.17:0/1207833122 >> v2:172.21.15.153:3300/0 conn(0x7fcaec151f30 0x7fcaec06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 >> v1:172.21.15.153:6789/0 conn(0x7fcaec0c4bd0 legacy=0x7fcaec0c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec158400 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7fcad8001670 con 0x7fcaec0c4fb0 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 >> v1:172.21.15.17:6789/0 conn(0x7fcaec0c4fb0 legacy=0x7fcaec151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 0x7fcad4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4004800 0x7fcad4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad40052e0 0x7fcad400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec158120 con 0x7fcad4003a00 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad400c220 con 0x7fcad40052e0 2024-03-19T06:39:19.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.877+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad400c420 con 0x7fcad4004800 2024-03-19T06:39:19.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.879+0000 7fcaf1200640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4004800 0x7fcad4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:19.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.881+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 0x7fcad4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf1c00640 1 -- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4004800 msgr2=0x7fcad4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4004800 0x7fcad4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf1c00640 1 -- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad40052e0 msgr2=0x7fcad400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad40052e0 0x7fcad400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf1c00640 1 -- 172.21.15.17:0/1207833122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4003520 con 0x7fcad4003a00 2024-03-19T06:39:19.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.884+0000 7fcaf2600640 1 -- 172.21.15.17:0/1207833122 reap_dead start 2024-03-19T06:39:19.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.888+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 0x7fcad4003e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcae0001620 tx=0x7fcad4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f2b14614deb868 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.893+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0001220 con 0x7fcad4003a00 2024-03-19T06:39:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.893+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0005070 con 0x7fcad4003a00 2024-03-19T06:39:19.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.893+0000 7fcaebe00640 1 -- 172.21.15.17:0/1207833122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0003610 con 0x7fcad4003a00 2024-03-19T06:39:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 -- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 msgr2=0x7fcad4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 0x7fcad4003e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcae0001620 tx=0x7fcad4005830 comp rx=0 tx=0).stop 2024-03-19T06:39:19.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 -- 172.21.15.17:0/1207833122 shutdown_connections 2024-03-19T06:39:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 --2- 172.21.15.17:0/1207833122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcad4003a00 0x7fcad4003e00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 -- 172.21.15.17:0/1207833122 >> 172.21.15.17:0/1207833122 conn(0x7fcaec06d770 msgr2=0x7fcaec06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.894+0000 7fcaf3000640 1 -- 172.21.15.17:0/1207833122 shutdown_connections 2024-03-19T06:39:19.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.895+0000 7fcaf3000640 1 -- 172.21.15.17:0/1207833122 wait complete. 2024-03-19T06:39:19.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.898+0000 7fcaf3000640 1 Processor -- start 2024-03-19T06:39:19.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.899+0000 7fcaf3000640 1 -- start start 2024-03-19T06:39:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaec1533a0 0x7fcaec0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec152e50 0x7fcaec0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec070aa0 con 0x7fcaec1533a0 2024-03-19T06:39:19.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0cc070 con 0x7fcaec152e50 2024-03-19T06:39:19.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.900+0000 7fcaf3000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec070c20 con 0x7fcad4003a00 2024-03-19T06:39:19.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.902+0000 7fcaf1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.903+0000 7fcaf1c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:53232/0 (socket says 172.21.15.17:53232) 2024-03-19T06:39:19.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.903+0000 7fcaf1c00640 1 -- 172.21.15.17:0/3759362669 learned_addr learned my addr 172.21.15.17:0/3759362669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:19.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.913+0000 7fcaf1c00640 1 -- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec152e50 msgr2=0x7fcaec0c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.913+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec152e50 0x7fcaec0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.913+0000 7fcaf1c00640 1 -- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaec1533a0 msgr2=0x7fcaec0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.913+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaec1533a0 0x7fcaec0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:19.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.913+0000 7fcaf1c00640 1 -- 172.21.15.17:0/3759362669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec1f0b20 con 0x7fcad4003a00 2024-03-19T06:39:19.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.920+0000 7fcaf1c00640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcae002bb90 tx=0x7fcae0000fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.936+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0042020 con 0x7fcad4003a00 2024-03-19T06:39:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.937+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0039040 con 0x7fcad4003a00 2024-03-19T06:39:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.937+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0003c60 con 0x7fcad4003a00 2024-03-19T06:39:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.937+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec1f32b0 con 0x7fcad4003a00 2024-03-19T06:39:19.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.937+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1f3870 con 0x7fcad4003a00 2024-03-19T06:39:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:19.939+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec04f050 con 0x7fcad4003a00 2024-03-19T06:39:19.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.000+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fcae0045020 con 0x7fcad4003a00 2024-03-19T06:39:19.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.002+0000 7fcae9600640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 0x7fcacc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.003+0000 7fcaf1200640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 0x7fcacc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.005+0000 7fcaf1200640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 0x7fcacc06e0e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001050 tx=0x7fcad8001b60 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.006+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcae0003e00 con 0x7fcad4003a00 2024-03-19T06:39:20.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.344+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fcae007b480 con 0x7fcad4003a00 2024-03-19T06:39:20.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:20.568+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcaec0716d0 con 0x7fcad4003a00 2024-03-19T06:39:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.081+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcae007ad80 con 0x7fcad4003a00 2024-03-19T06:39:21.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.081+0000 7fcae9600640 1 -- 172.21.15.17:0/3759362669 <== mon.2 v2:172.21.15.153:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcae007eed0 con 0x7fcad4003a00 2024-03-19T06:39:21.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.085+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 msgr2=0x7fcacc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.085+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 0x7fcacc06e0e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcad8001050 tx=0x7fcad8001b60 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 msgr2=0x7fcaec147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcae002bb90 tx=0x7fcae0000fb0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 shutdown_connections 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fcacc06bc20 0x7fcacc06e0e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec152e50 0x7fcaec0c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcaec1533a0 0x7fcaec0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 --2- 172.21.15.17:0/3759362669 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fcad4003a00 0x7fcaec147e80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 >> 172.21.15.17:0/3759362669 conn(0x7fcaec06d770 msgr2=0x7fcaec150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 shutdown_connections 2024-03-19T06:39:21.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.086+0000 7fcaf3000640 1 -- 172.21.15.17:0/3759362669 wait complete. 2024-03-19T06:39:21.096 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-19T06:39:21.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:39:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.333+0000 7fc499000640 1 Processor -- start 2024-03-19T06:39:21.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.333+0000 7fc499000640 1 -- start start 2024-03-19T06:39:21.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.335+0000 7fc499000640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc494153df0 0x7fc4940c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.335+0000 7fc499000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4940717c0 0x7fc49415d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.335+0000 7fc499000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4941541d0 con 0x7fc4940c5c50 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.335+0000 7fc499000640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc494159a50 con 0x7fc494153df0 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.335+0000 7fc499000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940c6b80 con 0x7fc4940717c0 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.336+0000 7fc492a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc4940c5c50 0x7fc4940710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59162/0 (socket says 172.21.15.17:59162) 2024-03-19T06:39:21.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.336+0000 7fc492a00640 1 -- 172.21.15.17:0/2436684288 learned_addr learned my addr 172.21.15.17:0/2436684288 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:39:21.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.337+0000 7fc493400640 1 --2- 172.21.15.17:0/2436684288 >> v2:172.21.15.153:3300/0 conn(0x7fc494153df0 0x7fc4940c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:21.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.337+0000 7fc493e00640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4940717c0 0x7fc49415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.340+0000 7fc492000640 1 -- 172.21.15.17:0/2436684288 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530435907 0 0) 0x7fc4941541d0 con 0x7fc4940c5c50 2024-03-19T06:39:21.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.340+0000 7fc492000640 1 -- 172.21.15.17:0/2436684288 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc478003520 con 0x7fc4940c5c50 2024-03-19T06:39:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.344+0000 7fc493400640 1 -- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4940717c0 msgr2=0x7fc49415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.344+0000 7fc493400640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4940717c0 0x7fc49415d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.344+0000 7fc493400640 1 -- 172.21.15.17:0/2436684288 >> v1:172.21.15.17:6789/0 conn(0x7fc4940c5c50 legacy=0x7fc4940710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.344+0000 7fc493400640 1 -- 172.21.15.17:0/2436684288 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940c6e60 con 0x7fc494153df0 2024-03-19T06:39:21.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.351+0000 7fc493400640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc494153df0 0x7fc4940c53d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4840097a0 tx=0x7fc48402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7c0eafc1631e6e server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.360+0000 7fc492000640 1 -- 172.21.15.17:0/2436684288 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484034070 con 0x7fc494153df0 2024-03-19T06:39:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.360+0000 7fc492000640 1 -- 172.21.15.17:0/2436684288 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc484030800 con 0x7fc494153df0 2024-03-19T06:39:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.360+0000 7fc492000640 1 -- 172.21.15.17:0/2436684288 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484030bf0 con 0x7fc494153df0 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 -- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc494153df0 msgr2=0x7fc4940c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc494153df0 0x7fc4940c53d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc4840097a0 tx=0x7fc48402b940 comp rx=0 tx=0).stop 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 -- 172.21.15.17:0/2436684288 shutdown_connections 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc4940717c0 0x7fc49415d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 --2- 172.21.15.17:0/2436684288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc494153df0 0x7fc4940c53d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 -- 172.21.15.17:0/2436684288 >> 172.21.15.17:0/2436684288 conn(0x7fc49406e630 msgr2=0x7fc49406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 -- 172.21.15.17:0/2436684288 shutdown_connections 2024-03-19T06:39:21.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.361+0000 7fc499000640 1 -- 172.21.15.17:0/2436684288 wait complete. 2024-03-19T06:39:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.364+0000 7fc499000640 1 Processor -- start 2024-03-19T06:39:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.364+0000 7fc499000640 1 -- start start 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4940c5c50 0x7fc49414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc494153df0 0x7fc4940c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc494159ff0 con 0x7fc4940717c0 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc494159d10 con 0x7fc4940c5c50 2024-03-19T06:39:21.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.366+0000 7fc499000640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940c65d0 con 0x7fc494153df0 2024-03-19T06:39:21.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.367+0000 7fc493400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:21.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.367+0000 7fc493400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54760/0 (socket says 172.21.15.17:54760) 2024-03-19T06:39:21.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.367+0000 7fc493400640 1 -- 172.21.15.17:0/4173292222 learned_addr learned my addr 172.21.15.17:0/4173292222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.372+0000 7fc493400640 1 -- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc494153df0 msgr2=0x7fc4940c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.372+0000 7fc493400640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc494153df0 0x7fc4940c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.372+0000 7fc493400640 1 -- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4940c5c50 msgr2=0x7fc49414f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.372+0000 7fc493400640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4940c5c50 0x7fc49414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:21.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.372+0000 7fc493400640 1 -- 172.21.15.17:0/4173292222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940cc130 con 0x7fc4940717c0 2024-03-19T06:39:21.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.375+0000 7fc493400640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc4840098c0 tx=0x7fc4840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.380+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484034040 con 0x7fc4940717c0 2024-03-19T06:39:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.380+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc484030e50 con 0x7fc4940717c0 2024-03-19T06:39:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.380+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4840443f0 con 0x7fc4940717c0 2024-03-19T06:39:21.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.380+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4941f3a40 con 0x7fc4940717c0 2024-03-19T06:39:21.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.381+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49414be70 con 0x7fc4940717c0 2024-03-19T06:39:21.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.382+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4940686e0 con 0x7fc4940717c0 2024-03-19T06:39:21.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.411+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fc48404b060 con 0x7fc4940717c0 2024-03-19T06:39:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.413+0000 7fc48b400640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 0x7fc47406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:21.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.414+0000 7fc492a00640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 0x7fc47406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:21.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.414+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc484079320 con 0x7fc4940717c0 2024-03-19T06:39:21.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.415+0000 7fc492a00640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 0x7fc47406e110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f60 tx=0x7fc4800078f0 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:21.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:21.783+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc4940cc130 con 0x7fc4940717c0 2024-03-19T06:39:22.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.050+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4940c2600 con 0x7fc4940717c0 2024-03-19T06:39:22.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.114+0000 7fc48b400640 1 -- 172.21.15.17:0/4173292222 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6584 (secure 0 0 0) 0x7fc48403f070 con 0x7fc4940717c0 2024-03-19T06:39:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:39:22.100 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:39.432640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4279,"mds_1":4264,"mds_2":4242,"mds_3":4241,"mds_4":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"a","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":2,"incarnation":15,"state":"up:active","state_seq":19,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:active","state_seq":18,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:39:22.100 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 msgr2=0x7fc47406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 0x7fc47406e110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc480000f60 tx=0x7fc4800078f0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 msgr2=0x7fc49414b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc4840098c0 tx=0x7fc4840046c0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 shutdown_connections 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc494153df0 0x7fc4940c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fc47406bc50 0x7fc47406e110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4940c5c50 0x7fc49414f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 --2- 172.21.15.17:0/4173292222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4940717c0 0x7fc49414b370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 >> 172.21.15.17:0/4173292222 conn(0x7fc49406e630 msgr2=0x7fc494150340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 shutdown_connections 2024-03-19T06:39:22.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.118+0000 7fc499000640 1 -- 172.21.15.17:0/4173292222 wait complete. 2024-03-19T06:39:22.125 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-19T06:39:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.359+0000 7fb274600640 1 Processor -- start 2024-03-19T06:39:22.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.359+0000 7fb274600640 1 -- start start 2024-03-19T06:39:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.361+0000 7fb274600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb26c153ed0 0x7fb26c15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.361+0000 7fb274600640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb26c06eb90 0x7fb26c070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.361+0000 7fb274600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26c1542b0 con 0x7fb26c06e720 2024-03-19T06:39:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.361+0000 7fb274600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c06efa0 con 0x7fb26c153ed0 2024-03-19T06:39:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.361+0000 7fb274600640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26c15e1d0 con 0x7fb26c06eb90 2024-03-19T06:39:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.363+0000 7fb271200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb26c06e720 0x7fb26c0c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59164/0 (socket says 172.21.15.17:59164) 2024-03-19T06:39:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.363+0000 7fb271200640 1 -- 172.21.15.17:0/2696673093 learned_addr learned my addr 172.21.15.17:0/2696673093 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:39:22.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.363+0000 7fb271c00640 1 --2- 172.21.15.17:0/2696673093 >> v2:172.21.15.17:3300/0 conn(0x7fb26c153ed0 0x7fb26c15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.363+0000 7fb272600640 1 --2- 172.21.15.17:0/2696673093 >> v2:172.21.15.153:3300/0 conn(0x7fb26c06eb90 0x7fb26c070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.366+0000 7fb271c00640 1 -- 172.21.15.17:0/2696673093 >> v2:172.21.15.153:3300/0 conn(0x7fb26c06eb90 msgr2=0x7fb26c070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.366+0000 7fb271c00640 1 --2- 172.21.15.17:0/2696673093 >> v2:172.21.15.153:3300/0 conn(0x7fb26c06eb90 0x7fb26c070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.366+0000 7fb271c00640 1 -- 172.21.15.17:0/2696673093 >> v1:172.21.15.17:6789/0 conn(0x7fb26c06e720 legacy=0x7fb26c0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.366+0000 7fb271c00640 1 -- 172.21.15.17:0/2696673093 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c15d5c0 con 0x7fb26c153ed0 2024-03-19T06:39:22.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.372+0000 7fb271c00640 1 --2- 172.21.15.17:0/2696673093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c153ed0 0x7fb26c15aa00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0732c0 tx=0x7fb26402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1276c09e1b11bcc server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.378+0000 7fb26be00640 1 -- 172.21.15.17:0/2696673093 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264035020 con 0x7fb26c153ed0 2024-03-19T06:39:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.378+0000 7fb26be00640 1 -- 172.21.15.17:0/2696673093 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb264031830 con 0x7fb26c153ed0 2024-03-19T06:39:22.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.378+0000 7fb26be00640 1 -- 172.21.15.17:0/2696673093 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb264031c20 con 0x7fb26c153ed0 2024-03-19T06:39:22.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 -- 172.21.15.17:0/2696673093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c153ed0 msgr2=0x7fb26c15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 --2- 172.21.15.17:0/2696673093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c153ed0 0x7fb26c15aa00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0732c0 tx=0x7fb26402b8d0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 -- 172.21.15.17:0/2696673093 shutdown_connections 2024-03-19T06:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 --2- 172.21.15.17:0/2696673093 >> v2:172.21.15.153:3300/0 conn(0x7fb26c06eb90 0x7fb26c070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 --2- 172.21.15.17:0/2696673093 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c153ed0 0x7fb26c15aa00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.379+0000 7fb274600640 1 -- 172.21.15.17:0/2696673093 >> 172.21.15.17:0/2696673093 conn(0x7fb26c0c8910 msgr2=0x7fb26c0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.380+0000 7fb274600640 1 -- 172.21.15.17:0/2696673093 shutdown_connections 2024-03-19T06:39:22.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.380+0000 7fb274600640 1 -- 172.21.15.17:0/2696673093 wait complete. 2024-03-19T06:39:22.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.382+0000 7fb274600640 1 Processor -- start 2024-03-19T06:39:22.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.383+0000 7fb274600640 1 -- start start 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb26c06e720 0x7fb26c158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c153ed0 0x7fb26c071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c15de60 con 0x7fb26c06eb90 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c15db80 con 0x7fb26c153ed0 2024-03-19T06:39:22.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.384+0000 7fb274600640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26c0c68f0 con 0x7fb26c06e720 2024-03-19T06:39:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.385+0000 7fb271200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.385+0000 7fb271200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54776/0 (socket says 172.21.15.17:54776) 2024-03-19T06:39:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.385+0000 7fb271200640 1 -- 172.21.15.17:0/2364164925 learned_addr learned my addr 172.21.15.17:0/2364164925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:22.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.386+0000 7fb272600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c153ed0 0x7fb26c071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.389+0000 7fb271200640 1 -- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb26c06e720 msgr2=0x7fb26c158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.389+0000 7fb271c00640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb26c06e720 0x7fb26c158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.390+0000 7fb271200640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb26c06e720 0x7fb26c158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.390+0000 7fb271200640 1 -- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c153ed0 msgr2=0x7fb26c071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.390+0000 7fb271200640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c153ed0 0x7fb26c071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.390+0000 7fb271200640 1 -- 172.21.15.17:0/2364164925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c1efd30 con 0x7fb26c06eb90 2024-03-19T06:39:22.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.392+0000 7fb271200640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb25800caa0 tx=0x7fb25800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.397+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258017070 con 0x7fb26c06eb90 2024-03-19T06:39:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.397+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb25800ac00 con 0x7fb26c06eb90 2024-03-19T06:39:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.397+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258012400 con 0x7fb26c06eb90 2024-03-19T06:39:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.397+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c1f0010 con 0x7fb26c06eb90 2024-03-19T06:39:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.397+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb26c1f05d0 con 0x7fb26c06eb90 2024-03-19T06:39:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.398+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26c0c3990 con 0x7fb26c06eb90 2024-03-19T06:39:22.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.718+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fb25801a070 con 0x7fb26c06eb90 2024-03-19T06:39:22.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.721+0000 7fb269600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 0x7fb24c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:22.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.721+0000 7fb271c00640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 0x7fb24c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:22.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.722+0000 7fb271c00640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 0x7fb24c06e0e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb264036000 tx=0x7fb264008030 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:22.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.757+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb2580573d0 con 0x7fb26c06eb90 2024-03-19T06:39:22.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:22.759+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fb26c0c3990 con 0x7fb26c06eb90 2024-03-19T06:39:23.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.015+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb26c0c6d40 con 0x7fb26c06eb90 2024-03-19T06:39:23.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.064+0000 7fb269600640 1 -- 172.21.15.17:0/2364164925 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6584 (secure 0 0 0) 0x7fb258021020 con 0x7fb26c06eb90 2024-03-19T06:39:23.049 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:39:23.049 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1695565074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1695565074},{"type":"v1","addr":"172.21.15.153:6835","nonce":1695565074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-19T06:06:34.436434+0000","modified":"2024-03-19T06:07:39.432640+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4279,"mds_1":4264,"mds_2":4242,"mds_3":4241,"mds_4":4235},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4235":{"gid":4235,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":21,"addr":"172.21.15.153:6837/1865535875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1865535875},{"type":"v1","addr":"172.21.15.153:6837","nonce":1865535875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4241":{"gid":4241,"name":"a","rank":3,"incarnation":17,"state":"up:active","state_seq":20,"addr":"172.21.15.17:6837/3549659421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":3549659421},{"type":"v1","addr":"172.21.15.17:6837","nonce":3549659421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4242":{"gid":4242,"name":"e","rank":2,"incarnation":15,"state":"up:active","state_seq":19,"addr":"172.21.15.17:6835/191121570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":191121570},{"type":"v1","addr":"172.21.15.17:6835","nonce":191121570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4264":{"gid":4264,"name":"d","rank":1,"incarnation":11,"state":"up:active","state_seq":18,"addr":"172.21.15.153:6833/578472937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":578472937},{"type":"v1","addr":"172.21.15.153:6833","nonce":578472937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4279":{"gid":4279,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":5,"addr":"172.21.15.17:6839/3325197099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6838","nonce":3325197099},{"type":"v1","addr":"172.21.15.17:6839","nonce":3325197099}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-19T06:39:23.049 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 20 2024-03-19T06:39:23.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 msgr2=0x7fb24c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 0x7fb24c06e0e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb264036000 tx=0x7fb264008030 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 msgr2=0x7fb26c149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fb25800caa0 tx=0x7fb25800cf60 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 shutdown_connections 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fb24c06bc20 0x7fb24c06e0e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb26c153ed0 0x7fb26c071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb26c06eb90 0x7fb26c149a50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 --2- 172.21.15.17:0/2364164925 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fb26c06e720 0x7fb26c158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.067+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 >> 172.21.15.17:0/2364164925 conn(0x7fb26c0c8910 msgr2=0x7fb26c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.068+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 shutdown_connections 2024-03-19T06:39:23.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.068+0000 7fb274600640 1 -- 172.21.15.17:0/2364164925 wait complete. 2024-03-19T06:39:23.075 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-19T06:39:23.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.291+0000 7f823bc00640 1 Processor -- start 2024-03-19T06:39:23.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.291+0000 7f823bc00640 1 -- start start 2024-03-19T06:39:23.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.292+0000 7f823bc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8234153ed0 0x7f823415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.293+0000 7f823bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406eb90 0x7f8234070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.293+0000 7f823bc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82341542b0 con 0x7f823406e720 2024-03-19T06:39:23.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.293+0000 7f823bc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823415e1d0 con 0x7f8234153ed0 2024-03-19T06:39:23.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.293+0000 7f823bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823415d5c0 con 0x7f823406eb90 2024-03-19T06:39:23.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.295+0000 7f8239200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8234153ed0 0x7f823415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:23.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.296+0000 7f8233e00640 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f823406e720 0x7f82340c61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.17:44812/0 (socket says 172.21.15.17:44812) 2024-03-19T06:39:23.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.296+0000 7f8233e00640 1 -- 172.21.15.17:0/2793225410 learned_addr learned my addr 172.21.15.17:0/2793225410 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.303+0000 7f8239200640 1 -- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406eb90 msgr2=0x7f8234070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:23.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.303+0000 7f8239200640 1 --2- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406eb90 0x7f8234070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.303+0000 7f8239200640 1 -- 172.21.15.17:0/2793225410 >> v1:172.21.15.153:6789/0 conn(0x7f823406e720 legacy=0x7f82340c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.303+0000 7f8239200640 1 -- 172.21.15.17:0/2793225410 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823415d8a0 con 0x7f8234153ed0 2024-03-19T06:39:23.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.308+0000 7f8239200640 1 --2- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f823415aa00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82280097a0 tx=0x7f822802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b0e415d5d9969f server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.323+0000 7f8233400640 1 -- 172.21.15.17:0/2793225410 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228035020 con 0x7f8234153ed0 2024-03-19T06:39:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.323+0000 7f8233400640 1 -- 172.21.15.17:0/2793225410 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8228031830 con 0x7f8234153ed0 2024-03-19T06:39:23.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.323+0000 7f8233400640 1 -- 172.21.15.17:0/2793225410 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228031c20 con 0x7f8234153ed0 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 -- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 msgr2=0x7f823415aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 --2- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f823415aa00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f82280097a0 tx=0x7f822802b8d0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 -- 172.21.15.17:0/2793225410 shutdown_connections 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 --2- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406eb90 0x7f8234070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 --2- 172.21.15.17:0/2793225410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f823415aa00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 -- 172.21.15.17:0/2793225410 >> 172.21.15.17:0/2793225410 conn(0x7f82340c8910 msgr2=0x7f82340cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 -- 172.21.15.17:0/2793225410 shutdown_connections 2024-03-19T06:39:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.324+0000 7f823bc00640 1 -- 172.21.15.17:0/2793225410 wait complete. 2024-03-19T06:39:23.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.326+0000 7f823bc00640 1 Processor -- start 2024-03-19T06:39:23.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.326+0000 7f823bc00640 1 -- start start 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.327+0000 7f823bc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406e720 0x7f82341f0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.328+0000 7f823bc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.328+0000 7f823bc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f82341522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.328+0000 7f823bc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c68f0 con 0x7f823406eb90 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.328+0000 7f823bc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823415de60 con 0x7f8234153ed0 2024-03-19T06:39:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.328+0000 7f823bc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340c6a70 con 0x7f823406e720 2024-03-19T06:39:23.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.329+0000 7f8233e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:23.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.329+0000 7f8233e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54792/0 (socket says 172.21.15.17:54792) 2024-03-19T06:39:23.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.329+0000 7f8233e00640 1 -- 172.21.15.17:0/757571792 learned_addr learned my addr 172.21.15.17:0/757571792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.330+0000 7f8239c00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f82341522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.334+0000 7f8233e00640 1 -- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406e720 msgr2=0x7f82341f0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.334+0000 7f8233e00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406e720 0x7f82341f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.334+0000 7f8233e00640 1 -- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 msgr2=0x7f82341522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.334+0000 7f8233e00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f82341522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.334+0000 7f8233e00640 1 -- 172.21.15.17:0/757571792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82341efc70 con 0x7f823406eb90 2024-03-19T06:39:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.336+0000 7f8233e00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f822400c430 tx=0x7f822400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.342+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224017070 con 0x7f823406eb90 2024-03-19T06:39:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.342+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8224005ce0 con 0x7f823406eb90 2024-03-19T06:39:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.342+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224007310 con 0x7f823406eb90 2024-03-19T06:39:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.342+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340cb660 con 0x7f823406eb90 2024-03-19T06:39:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.343+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823414af70 con 0x7f823406eb90 2024-03-19T06:39:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.344+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8234069be0 con 0x7f823406eb90 2024-03-19T06:39:23.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.660+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f822401a070 con 0x7f823406eb90 2024-03-19T06:39:23.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.662+0000 7f8230c00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 0x7f821806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.663+0000 7f8239200640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 0x7f821806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.665+0000 7f8239200640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 0x7f821806e0e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8228036000 tx=0x7f8228030000 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:23.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.701+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f82240567f0 con 0x7f823406eb90 2024-03-19T06:39:23.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.702+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f8224021020 con 0x7f823406eb90 2024-03-19T06:39:23.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:23.919+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82340725a0 con 0x7f823406eb90 2024-03-19T06:39:24.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.023+0000 7f8230c00640 1 -- 172.21.15.17:0/757571792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18836 (secure 0 0 0) 0x7f8224058e50 con 0x7f823406eb90 2024-03-19T06:39:24.008 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-19T06:39:24.009 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"fsid":"b76b09f0-0b97-45ba-8841-90df0fadb075","created":"2024-03-19T06:05:45.216358+0000","modified":"2024-03-19T06:07:01.877455+0000","last_up_change":"2024-03-19T06:06:07.046304+0000","last_in_change":"2024-03-19T06:05:55.829392+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-19T06:06:07.816327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-19T06:06:30.394430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-19T06:06:32.423654+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-19T06:06:39.891065+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"da7555cf-85e9-4418-bee6-b02e1fb27a27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6817","nonce":3775910215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6819","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6821","nonce":3775910215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6829","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6831","nonce":3775910215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3775910215},{"type":"v1","addr":"172.21.15.17:6827","nonce":3775910215}]},"public_addr":"172.21.15.17:6817/3775910215","cluster_addr":"172.21.15.17:6821/3775910215","heartbeat_back_addr":"172.21.15.17:6831/3775910215","heartbeat_front_addr":"172.21.15.17:6827/3775910215","state":["exists","up"]},{"osd":1,"uuid":"2e7fbcf4-0887-438f-8d45-d901f6325e42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6820","nonce":872185476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6823","nonce":872185476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6830","nonce":872185476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":872185476},{"type":"v1","addr":"172.21.15.17:6826","nonce":872185476}]},"public_addr":"172.21.15.17:6820/872185476","cluster_addr":"172.21.15.17:6823/872185476","heartbeat_back_addr":"172.21.15.17:6830/872185476","heartbeat_front_addr":"172.21.15.17:6826/872185476","state":["exists","up"]},{"osd":2,"uuid":"ea39ea9b-041e-44b6-a3a6-a64d65b66184","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6801","nonce":4048444499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6803","nonce":4048444499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6807","nonce":4048444499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":4048444499},{"type":"v1","addr":"172.21.15.17:6805","nonce":4048444499}]},"public_addr":"172.21.15.17:6801/4048444499","cluster_addr":"172.21.15.17:6803/4048444499","heartbeat_back_addr":"172.21.15.17:6807/4048444499","heartbeat_front_addr":"172.21.15.17:6805/4048444499","state":["exists","up"]},{"osd":3,"uuid":"a24e2f49-1b63-4e94-9d81-2d1e5ef0113d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6809","nonce":439475340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6811","nonce":439475340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6815","nonce":439475340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":439475340},{"type":"v1","addr":"172.21.15.17:6813","nonce":439475340}]},"public_addr":"172.21.15.17:6809/439475340","cluster_addr":"172.21.15.17:6811/439475340","heartbeat_back_addr":"172.21.15.17:6815/439475340","heartbeat_front_addr":"172.21.15.17:6813/439475340","state":["exists","up"]},{"osd":4,"uuid":"a83ad80a-7b4a-4cb0-b25c-fdaae6ecd16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6801","nonce":1857527364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6803","nonce":1857527364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6807","nonce":1857527364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1857527364},{"type":"v1","addr":"172.21.15.153:6805","nonce":1857527364}]},"public_addr":"172.21.15.153:6801/1857527364","cluster_addr":"172.21.15.153:6803/1857527364","heartbeat_back_addr":"172.21.15.153:6807/1857527364","heartbeat_front_addr":"172.21.15.153:6805/1857527364","state":["exists","up"]},{"osd":5,"uuid":"407c9283-7a38-4330-878a-a2fc8c1a92d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6809","nonce":1960976366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6813","nonce":1960976366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6820","nonce":1960976366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":1960976366},{"type":"v1","addr":"172.21.15.153:6817","nonce":1960976366}]},"public_addr":"172.21.15.153:6809/1960976366","cluster_addr":"172.21.15.153:6813/1960976366","heartbeat_back_addr":"172.21.15.153:6820/1960976366","heartbeat_front_addr":"172.21.15.153:6817/1960976366","state":["exists","up"]},{"osd":6,"uuid":"6267f24d-9008-4cb3-8f2e-2a776bed6c50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6812","nonce":1824749759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6816","nonce":1824749759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6823","nonce":1824749759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":1824749759},{"type":"v1","addr":"172.21.15.153:6821","nonce":1824749759}]},"public_addr":"172.21.15.153:6812/1824749759","cluster_addr":"172.21.15.153:6816/1824749759","heartbeat_back_addr":"172.21.15.153:6823/1824749759","heartbeat_front_addr":"172.21.15.153:6821/1824749759","state":["exists","up"]},{"osd":7,"uuid":"a91e5ede-c41f-497e-8cda-3d146ea4c3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6825","nonce":3824547311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6827","nonce":3824547311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6831","nonce":3824547311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":3824547311},{"type":"v1","addr":"172.21.15.153:6829","nonce":3824547311}]},"public_addr":"172.21.15.153:6825/3824547311","cluster_addr":"172.21.15.153:6827/3824547311","heartbeat_back_addr":"172.21.15.153:6831/3824547311","heartbeat_front_addr":"172.21.15.153:6829/3824547311","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.209157+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.407477+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.408508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.371275+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.546847+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.631069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.189448+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-19T06:06:01.733568+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 msgr2=0x7f821806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 0x7f821806e0e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8228036000 tx=0x7f8228030000 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 msgr2=0x7f82341f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f822400c430 tx=0x7f822400c8f0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 shutdown_connections 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f821806bc20 0x7f821806e0e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234153ed0 0x7f82341522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f823406eb90 0x7f82341f30f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.026+0000 7f823bc00640 1 --2- 172.21.15.17:0/757571792 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f823406e720 0x7f82341f0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.027+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 >> 172.21.15.17:0/757571792 conn(0x7f82340c8910 msgr2=0x7f8234071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.027+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 shutdown_connections 2024-03-19T06:39:24.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.027+0000 7f823bc00640 1 -- 172.21.15.17:0/757571792 wait complete. 2024-03-19T06:39:24.033 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-19T06:39:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.261+0000 7f2a61800640 1 Processor -- start 2024-03-19T06:39:24.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.262+0000 7f2a61800640 1 -- start start 2024-03-19T06:39:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.263+0000 7f2a61800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2a5c0c9410 0x7f2a5c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.263+0000 7f2a61800640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a5c15b080 0x7f2a5c15dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.263+0000 7f2a61800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c15a200 con 0x7f2a5c0ca3b0 2024-03-19T06:39:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.263+0000 7f2a61800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c15a4c0 con 0x7f2a5c0c9410 2024-03-19T06:39:24.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.263+0000 7f2a61800640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c15a7a0 con 0x7f2a5c15b080 2024-03-19T06:39:24.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.265+0000 7f2a5be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2a5c0c9410 0x7f2a5c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.265+0000 7f2a5b400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a5c15b080 0x7f2a5c15dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.266+0000 7f2a5b400640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a5c15b080 0x7f2a5c15dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:60694/0 (socket says 172.21.15.17:60694) 2024-03-19T06:39:24.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.266+0000 7f2a5b400640 1 -- 172.21.15.17:0/1271403515 learned_addr learned my addr 172.21.15.17:0/1271403515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.272+0000 7f2a5b400640 1 -- 172.21.15.17:0/1271403515 >> v2:172.21.15.17:3300/0 conn(0x7f2a5c0c9410 msgr2=0x7f2a5c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.272+0000 7f2a5b400640 1 --2- 172.21.15.17:0/1271403515 >> v2:172.21.15.17:3300/0 conn(0x7f2a5c0c9410 0x7f2a5c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.272+0000 7f2a5b400640 1 -- 172.21.15.17:0/1271403515 >> v1:172.21.15.17:6789/0 conn(0x7f2a5c0ca3b0 legacy=0x7f2a5c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.272+0000 7f2a5b400640 1 -- 172.21.15.17:0/1271403515 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c15aa80 con 0x7f2a5c15b080 2024-03-19T06:39:24.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.278+0000 7f2a5b400640 1 --2- 172.21.15.17:0/1271403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c15dc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c154550 tx=0x7f2a4402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa014e7cef8e79b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:24.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.289+0000 7f2a5aa00640 1 -- 172.21.15.17:0/1271403515 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44035020 con 0x7f2a5c15b080 2024-03-19T06:39:24.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.289+0000 7f2a5aa00640 1 -- 172.21.15.17:0/1271403515 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2a44031870 con 0x7f2a5c15b080 2024-03-19T06:39:24.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.289+0000 7f2a5aa00640 1 -- 172.21.15.17:0/1271403515 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44031c60 con 0x7f2a5c15b080 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 -- 172.21.15.17:0/1271403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 msgr2=0x7f2a5c15dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 --2- 172.21.15.17:0/1271403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c15dc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c154550 tx=0x7f2a4402b910 comp rx=0 tx=0).stop 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 -- 172.21.15.17:0/1271403515 shutdown_connections 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 --2- 172.21.15.17:0/1271403515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c15dc60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 --2- 172.21.15.17:0/1271403515 >> v2:172.21.15.17:3300/0 conn(0x7f2a5c0c9410 0x7f2a5c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 -- 172.21.15.17:0/1271403515 >> 172.21.15.17:0/1271403515 conn(0x7f2a5c072360 msgr2=0x7f2a5c072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 -- 172.21.15.17:0/1271403515 shutdown_connections 2024-03-19T06:39:24.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.290+0000 7f2a61800640 1 -- 172.21.15.17:0/1271403515 wait complete. 2024-03-19T06:39:24.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.293+0000 7f2a61800640 1 Processor -- start 2024-03-19T06:39:24.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.293+0000 7f2a61800640 1 -- start start 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a5c0ca3b0 0x7f2a5c1f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c15d740 con 0x7f2a5c0c9410 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c15d460 con 0x7f2a5c15b080 2024-03-19T06:39:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.295+0000 7f2a61800640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0cb5b0 con 0x7f2a5c0ca3b0 2024-03-19T06:39:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.296+0000 7f2a5be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.296+0000 7f2a5be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54816/0 (socket says 172.21.15.17:54816) 2024-03-19T06:39:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.296+0000 7f2a5be00640 1 -- 172.21.15.17:0/2271695893 learned_addr learned my addr 172.21.15.17:0/2271695893 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.297+0000 7f2a60e00640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.297+0000 7f2a5b400640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a5c0ca3b0 0x7f2a5c1f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.302+0000 7f2a5be00640 1 -- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a5c0ca3b0 msgr2=0x7f2a5c1f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.302+0000 7f2a5be00640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a5c0ca3b0 0x7f2a5c1f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.302+0000 7f2a5be00640 1 -- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 msgr2=0x7f2a5c1539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.302+0000 7f2a5be00640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c1539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:24.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.302+0000 7f2a5be00640 1 -- 172.21.15.17:0/2271695893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c1e3d00 con 0x7f2a5c0c9410 2024-03-19T06:39:24.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.306+0000 7f2a5be00640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00d800 tx=0x7f2a4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:24.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.311+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00b6c0 con 0x7f2a5c0c9410 2024-03-19T06:39:24.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.311+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2a4c019070 con 0x7f2a5c0c9410 2024-03-19T06:39:24.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.311+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00baa0 con 0x7f2a5c0c9410 2024-03-19T06:39:24.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.311+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c156830 con 0x7f2a5c0c9410 2024-03-19T06:39:24.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.311+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c156df0 con 0x7f2a5c0c9410 2024-03-19T06:39:24.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.313+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c04f050 con 0x7f2a5c0c9410 2024-03-19T06:39:24.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.351+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2a4c00bc40 con 0x7f2a5c0c9410 2024-03-19T06:39:24.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.353+0000 7f2a53e00640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 0x7f2a3806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:24.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.354+0000 7f2a5b400640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 0x7f2a3806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:24.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.356+0000 7f2a5b400640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 0x7f2a3806e0e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a4403c040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:24.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.694+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2a4c057e00 con 0x7f2a5c0c9410 2024-03-19T06:39:24.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.695+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f2a4c059d60 con 0x7f2a5c0c9410 2024-03-19T06:39:24.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:24.953+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2a5c0cac80 con 0x7f2a5c0c9410 2024-03-19T06:39:25.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.135+0000 7f2a53e00640 1 -- 172.21.15.17:0/2271695893 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2a4c05de00 con 0x7f2a5c0c9410 2024-03-19T06:39:25.120 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 msgr2=0x7f2a3806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 0x7f2a3806e0e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a44036000 tx=0x7f2a4403c040 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 msgr2=0x7f2a5c1e36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c00d800 tx=0x7f2a4c00dcc0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 shutdown_connections 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2a3806bc20 0x7f2a3806e0e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a5c15b080 0x7f2a5c1539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2a5c0ca3b0 0x7f2a5c1f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 --2- 172.21.15.17:0/2271695893 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a5c0c9410 0x7f2a5c1e36e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 >> 172.21.15.17:0/2271695893 conn(0x7f2a5c072360 msgr2=0x7f2a5c15c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:25.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 shutdown_connections 2024-03-19T06:39:25.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.139+0000 7f2a61800640 1 -- 172.21.15.17:0/2271695893 wait complete. 2024-03-19T06:39:25.156 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-19T06:39:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.384+0000 7f03bda00640 1 Processor -- start 2024-03-19T06:39:25.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.384+0000 7f03bda00640 1 -- start start 2024-03-19T06:39:25.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.386+0000 7f03bda00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03b80c1e60 0x7f03b80c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:25.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.386+0000 7f03bda00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b80c27c0 con 0x7f03b8151f70 2024-03-19T06:39:25.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.386+0000 7f03bda00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b8157be0 con 0x7f03b815b1d0 2024-03-19T06:39:25.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.386+0000 7f03bda00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b8157f30 con 0x7f03b80c1e60 2024-03-19T06:39:25.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.388+0000 7f03b7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03b80c1e60 0x7f03b80c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.389+0000 7f03b7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f03b80c1e60 0x7f03b80c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54820/0 (socket says 172.21.15.17:54820) 2024-03-19T06:39:25.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.389+0000 7f03b7400640 1 -- 172.21.15.17:0/3754365053 learned_addr learned my addr 172.21.15.17:0/3754365053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.454+0000 7f03b7400640 1 -- 172.21.15.17:0/3754365053 >> v1:172.21.15.153:6789/0 conn(0x7f03b815b1d0 legacy=0x7f03b806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.454+0000 7f03b7400640 1 -- 172.21.15.17:0/3754365053 >> v1:172.21.15.17:6789/0 conn(0x7f03b8151f70 legacy=0x7f03b81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.454+0000 7f03b7400640 1 -- 172.21.15.17:0/3754365053 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b815b730 con 0x7f03b80c1e60 2024-03-19T06:39:25.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.460+0000 7f03b7400640 1 --2- 172.21.15.17:0/3754365053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b80c1e60 0x7f03b80c7760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f03b81580b0 tx=0x7f03b002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a42fbce80197a server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.467+0000 7f03b5600640 1 -- 172.21.15.17:0/3754365053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b002cc10 con 0x7f03b80c1e60 2024-03-19T06:39:25.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.468+0000 7f03b5600640 1 -- 172.21.15.17:0/3754365053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03b002cdb0 con 0x7f03b80c1e60 2024-03-19T06:39:25.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.468+0000 7f03b5600640 1 -- 172.21.15.17:0/3754365053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0034630 con 0x7f03b80c1e60 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 -- 172.21.15.17:0/3754365053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b80c1e60 msgr2=0x7f03b80c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 --2- 172.21.15.17:0/3754365053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b80c1e60 0x7f03b80c7760 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f03b81580b0 tx=0x7f03b002c070 comp rx=0 tx=0).stop 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 -- 172.21.15.17:0/3754365053 shutdown_connections 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 --2- 172.21.15.17:0/3754365053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b80c1e60 0x7f03b80c7760 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 -- 172.21.15.17:0/3754365053 >> 172.21.15.17:0/3754365053 conn(0x7f03b80c8910 msgr2=0x7f03b80cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 -- 172.21.15.17:0/3754365053 shutdown_connections 2024-03-19T06:39:25.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.469+0000 7f03bda00640 1 -- 172.21.15.17:0/3754365053 wait complete. 2024-03-19T06:39:25.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.472+0000 7f03bda00640 1 Processor -- start 2024-03-19T06:39:25.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.472+0000 7f03bda00640 1 -- start start 2024-03-19T06:39:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 0x7f03b8149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 0x7f03b80cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03b815b1d0 0x7f03b81f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b815bcf0 con 0x7f03b8151f70 2024-03-19T06:39:25.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8152350 con 0x7f03b80c1e60 2024-03-19T06:39:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.473+0000 7f03bda00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b815bfd0 con 0x7f03b815b1d0 2024-03-19T06:39:25.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.477+0000 7f03b6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 0x7f03b8149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.478+0000 7f03b6000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 0x7f03b80cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.478+0000 7f03b6a00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 0x7f03b8149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:60712/0 (socket says 172.21.15.17:60712) 2024-03-19T06:39:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.478+0000 7f03b6a00640 1 -- 172.21.15.17:0/4292019571 learned_addr learned my addr 172.21.15.17:0/4292019571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:25.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.479+0000 7f03b7400640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03b815b1d0 0x7f03b81f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.485+0000 7f03b6000640 1 -- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03b815b1d0 msgr2=0x7f03b81f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.485+0000 7f03b6000640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03b815b1d0 0x7f03b81f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.485+0000 7f03b6000640 1 -- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 msgr2=0x7f03b8149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.485+0000 7f03b6000640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 0x7f03b8149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:25.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.485+0000 7f03b6000640 1 -- 172.21.15.17:0/4292019571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b81f3ee0 con 0x7f03b8151f70 2024-03-19T06:39:25.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.489+0000 7f03b6000640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 0x7f03b80cb050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c3f0 tx=0x7f03a400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.494+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a40052d0 con 0x7f03b8151f70 2024-03-19T06:39:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.494+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f03a4005490 con 0x7f03b8151f70 2024-03-19T06:39:25.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.494+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4007280 con 0x7f03b8151f70 2024-03-19T06:39:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.495+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b81f3c00 con 0x7f03b8151f70 2024-03-19T06:39:25.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.496+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b80ca850 con 0x7f03b8151f70 2024-03-19T06:39:25.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.497+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b8069be0 con 0x7f03b8151f70 2024-03-19T06:39:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.792+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f03a4007420 con 0x7f03b8151f70 2024-03-19T06:39:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.793+0000 7f03aea00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 0x7f039806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.794+0000 7f03b6a00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 0x7f039806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:25.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.795+0000 7f03b6a00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 0x7f039806e0e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03a8001820 tx=0x7f03a8009040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:25.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.832+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7165+0+0 (secure 0 0 0) 0x7f03a4056e60 con 0x7f03b8151f70 2024-03-19T06:39:25.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:25.842+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f03a4058b60 con 0x7f03b8151f70 2024-03-19T06:39:26.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.134+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03b814c4a0 con 0x7f03b8151f70 2024-03-19T06:39:26.524 INFO:tasks.ceph.mds.b.smithi153.stderr:==00:00:33:12.219 42069== 2024-03-19T06:39:26.524 INFO:tasks.ceph.mds.b.smithi153.stderr:==00:00:33:12.219 42069== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:39:26.554 INFO:tasks.ceph.mds.e.smithi017.stderr:==00:00:33:12.250 40934== 2024-03-19T06:39:26.554 INFO:tasks.ceph.mds.e.smithi017.stderr:==00:00:33:12.250 40934== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:39:26.558 INFO:tasks.ceph.mds.c.smithi017.stderr:==00:00:33:12.255 40933== 2024-03-19T06:39:26.558 INFO:tasks.ceph.mds.c.smithi017.stderr:==00:00:33:12.255 40933== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:39:26.560 INFO:tasks.ceph.mds.a.smithi017.stderr:==00:00:33:12.269 40932== 2024-03-19T06:39:26.561 INFO:tasks.ceph.mds.a.smithi017.stderr:==00:00:33:12.269 40932== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:39:26.572 INFO:tasks.ceph.mds.d.smithi153.stderr:==00:00:33:12.259 42071== 2024-03-19T06:39:26.572 INFO:tasks.ceph.mds.d.smithi153.stderr:==00:00:33:12.259 42071== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:39:26.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.599+0000 7f03aea00640 1 -- 172.21.15.17:0/4292019571 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f03a405cc00 con 0x7f03b8151f70 2024-03-19T06:39:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 msgr2=0x7f039806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 0x7f039806e0e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03a8001820 tx=0x7f03a8009040 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 msgr2=0x7f03b80cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 0x7f03b80cb050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f03a400c3f0 tx=0x7f03a400c8b0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 shutdown_connections 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f03b815b1d0 0x7f03b81f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03b8151f70 0x7f03b80cb050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f039806bc20 0x7f039806e0e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 --2- 172.21.15.17:0/4292019571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03b80c1e60 0x7f03b8149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 >> 172.21.15.17:0/4292019571 conn(0x7f03b80c8910 msgr2=0x7f03b806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 shutdown_connections 2024-03-19T06:39:26.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.602+0000 7f03bda00640 1 -- 172.21.15.17:0/4292019571 wait complete. 2024-03-19T06:39:26.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-19T06:39:26.651 INFO:tasks.ceph.mds.a.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:39:26.651 INFO:tasks.ceph.mds.c.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:39:26.651 INFO:tasks.ceph.mds.e.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:39:26.660 INFO:tasks.ceph.mds.b.smithi153.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:39:26.661 INFO:tasks.ceph.mds.d.smithi153.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:39:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.817+0000 7f2b0de00640 1 Processor -- start 2024-03-19T06:39:26.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.818+0000 7f2b0de00640 1 -- start start 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.819+0000 7f2b0de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 0x7f2b0815a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.819+0000 7f2b0de00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2b080ca360 0x7f2b080caee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.819+0000 7f2b0de00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080cbfb0 con 0x7f2b080c9f60 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.819+0000 7f2b0de00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080cc250 con 0x7f2b080ca360 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.819+0000 7f2b0de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cc530 con 0x7f2b08153bd0 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.820+0000 7f2b06000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2b080c9f60 0x7f2b0806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:59202/0 (socket says 172.21.15.17:59202) 2024-03-19T06:39:26.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.820+0000 7f2b06000640 1 -- 172.21.15.17:0/3650161382 learned_addr learned my addr 172.21.15.17:0/3650161382 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-19T06:39:26.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.821+0000 7f2b06a00640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 0x7f2b0815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.821+0000 7f2b07400640 1 --2- 172.21.15.17:0/3650161382 >> v2:172.21.15.153:3300/0 conn(0x7f2b080ca360 0x7f2b080caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.822+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599160998 0 0) 0x7f2b080cbfb0 con 0x7f2b080c9f60 2024-03-19T06:39:26.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.822+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec003520 con 0x7f2b080c9f60 2024-03-19T06:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 473812597 0 0) 0x7f2aec003520 con 0x7f2b080c9f60 2024-03-19T06:39:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 msgr2=0x7f2b0815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 0x7f2b0815a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 >> v2:172.21.15.153:3300/0 conn(0x7f2b080ca360 msgr2=0x7f2b080caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 --2- 172.21.15.17:0/3650161382 >> v2:172.21.15.153:3300/0 conn(0x7f2b080ca360 0x7f2b080caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080cc810 con 0x7f2b080c9f60 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2391212985 0 0) 0x7f2af0001670 con 0x7f2b080c9f60 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 >> v1:172.21.15.17:6789/0 conn(0x7f2b080c9f60 legacy=0x7f2b0806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 0x7f2aec0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec003fa0 0x7f2aec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2aec004d40 0x7f2aec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cc250 con 0x7f2aec004d40 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080cc530 con 0x7f2aec003fa0 2024-03-19T06:39:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.826+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec014280 con 0x7f2b08153bd0 2024-03-19T06:39:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.828+0000 7f2b07400640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2aec004d40 0x7f2aec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.833+0000 7f2b07400640 1 -- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 msgr2=0x7f2aec0039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.833+0000 7f2b07400640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b08153bd0 0x7f2aec0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.833+0000 7f2b07400640 1 -- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec003fa0 msgr2=0x7f2aec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.833+0000 7f2b07400640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec003fa0 0x7f2aec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.833+0000 7f2b07400640 1 -- 172.21.15.17:0/3650161382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec003520 con 0x7f2aec004d40 2024-03-19T06:39:26.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.835+0000 7f2b07400640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2aec004d40 0x7f2aec0051c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009ac0 tx=0x7f2aec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947e5d209630f0c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.839+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00039070 con 0x7f2aec004d40 2024-03-19T06:39:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.839+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b0002c710 con 0x7f2aec004d40 2024-03-19T06:39:26.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.839+0000 7f2b05600640 1 -- 172.21.15.17:0/3650161382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00009690 con 0x7f2aec004d40 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 -- 172.21.15.17:0/3650161382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2aec004d40 msgr2=0x7f2aec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 --2- 172.21.15.17:0/3650161382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2aec004d40 0x7f2aec0051c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009ac0 tx=0x7f2aec005830 comp rx=0 tx=0).stop 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b07400640 1 -- 172.21.15.17:0/3650161382 reap_dead start 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 -- 172.21.15.17:0/3650161382 shutdown_connections 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 -- 172.21.15.17:0/3650161382 >> 172.21.15.17:0/3650161382 conn(0x7f2b08066e10 msgr2=0x7f2b0806baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 -- 172.21.15.17:0/3650161382 shutdown_connections 2024-03-19T06:39:26.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.840+0000 7f2b0de00640 1 -- 172.21.15.17:0/3650161382 wait complete. 2024-03-19T06:39:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.842+0000 7f2b0de00640 1 Processor -- start 2024-03-19T06:39:26.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.842+0000 7f2b0de00640 1 -- start start 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec004d40 0x7f2b080cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b081ebd20 0x7f2b081435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08153fb0 con 0x7f2b080ced30 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080ccdd0 con 0x7f2aec004d40 2024-03-19T06:39:26.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.843+0000 7f2b0de00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08154130 con 0x7f2b081ebd20 2024-03-19T06:39:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.844+0000 7f2b06000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.845+0000 7f2b06000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54852/0 (socket says 172.21.15.17:54852) 2024-03-19T06:39:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.845+0000 7f2b06000640 1 -- 172.21.15.17:0/139876745 learned_addr learned my addr 172.21.15.17:0/139876745 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.845+0000 7f2b06a00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec004d40 0x7f2b080cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.845+0000 7f2b07400640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b081ebd20 0x7f2b081435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.851+0000 7f2b06000640 1 -- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b081ebd20 msgr2=0x7f2b081435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.851+0000 7f2b06000640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b081ebd20 0x7f2b081435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.851+0000 7f2b06000640 1 -- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec004d40 msgr2=0x7f2b080cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:26.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.851+0000 7f2b06000640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec004d40 0x7f2b080cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:26.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.851+0000 7f2b06000640 1 -- 172.21.15.17:0/139876745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b081ec1d0 con 0x7f2b080ced30 2024-03-19T06:39:26.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.855+0000 7f2b06000640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c7d0 tx=0x7f2af000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.861+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0018070 con 0x7f2b080ced30 2024-03-19T06:39:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.861+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2af00074e0 con 0x7f2b080ced30 2024-03-19T06:39:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.861+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0814d520 con 0x7f2b080ced30 2024-03-19T06:39:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.861+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0004a40 con 0x7f2b080ced30 2024-03-19T06:39:26.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.861+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0814dfd0 con 0x7f2b080ced30 2024-03-19T06:39:26.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.862+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b081580d0 con 0x7f2b080ced30 2024-03-19T06:39:26.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.887+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f2af001b070 con 0x7f2b080ced30 2024-03-19T06:39:26.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.891+0000 7f2aff400640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 0x7f2ae406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.891+0000 7f2b06a00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 0x7f2ae406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:26.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:26.892+0000 7f2b06a00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 0x7f2ae406e110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2af8004b30 tx=0x7f2af800d040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:27.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:27.205+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7165+0+0 (secure 0 0 0) 0x7f2af00569d0 con 0x7f2b080ced30 2024-03-19T06:39:27.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:27.207+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f2b081580d0 con 0x7f2b080ced30 2024-03-19T06:39:27.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:39:27.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:39:27.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:27.425+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b08069be0 con 0x7f2b080ced30 2024-03-19T06:39:27.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-03-19T06:39:27.861 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-03-19T06:39:27.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-03-19T06:39:27.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-03-19T06:39:27.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-03-19T06:39:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.776+0000 7f2aff400640 1 -- 172.21.15.17:0/139876745 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2af0022020 con 0x7f2b080ced30 2024-03-19T06:39:28.761 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-03-19T06:39:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 msgr2=0x7f2ae406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 0x7f2ae406e110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2af8004b30 tx=0x7f2af800d040 comp rx=0 tx=0).stop 2024-03-19T06:39:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 msgr2=0x7f2b0814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:28.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c7d0 tx=0x7f2af000cbd0 comp rx=0 tx=0).stop 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 shutdown_connections 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f2b081ebd20 0x7f2b081435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b080ced30 0x7f2b0814eab0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f2ae406bc50 0x7f2ae406e110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 --2- 172.21.15.17:0/139876745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2aec004d40 0x7f2b080cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 >> 172.21.15.17:0/139876745 conn(0x7f2b08066e10 msgr2=0x7f2b081583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.779+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 shutdown_connections 2024-03-19T06:39:28.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:28.780+0000 7f2b0de00640 1 -- 172.21.15.17:0/139876745 wait complete. 2024-03-19T06:39:28.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-19T06:39:29.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.059+0000 7fc019c00640 1 Processor -- start 2024-03-19T06:39:29.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.059+0000 7fc019c00640 1 -- start start 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca0f0 0x7fc0140c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0140ca4d0 0x7fc014153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc01406bd40 0x7fc014154310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01415d520 con 0x7fc0140ca4d0 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01406c660 con 0x7fc01406bd40 2024-03-19T06:39:29.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.061+0000 7fc019c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01406c940 con 0x7fc0140ca0f0 2024-03-19T06:39:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.062+0000 7fc012000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0140ca4d0 0x7fc014153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.063+0000 7fc012000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc0140ca4d0 0x7fc014153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54868/0 (socket says 172.21.15.17:54868) 2024-03-19T06:39:29.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.063+0000 7fc012000640 1 -- 172.21.15.17:0/3010542654 learned_addr learned my addr 172.21.15.17:0/3010542654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:29.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.063+0000 7fc012a00640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca0f0 0x7fc0140c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.063+0000 7fc013400640 1 --2- 172.21.15.17:0/3010542654 >> v2:172.21.15.153:3300/0 conn(0x7fc01406bd40 0x7fc014154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.066+0000 7fc012000640 1 -- 172.21.15.17:0/3010542654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca0f0 msgr2=0x7fc0140c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.066+0000 7fc012000640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca0f0 0x7fc0140c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.066+0000 7fc012000640 1 -- 172.21.15.17:0/3010542654 >> v2:172.21.15.153:3300/0 conn(0x7fc01406bd40 msgr2=0x7fc014154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.066+0000 7fc012000640 1 --2- 172.21.15.17:0/3010542654 >> v2:172.21.15.153:3300/0 conn(0x7fc01406bd40 0x7fc014154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.066+0000 7fc012000640 1 -- 172.21.15.17:0/3010542654 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01406cc20 con 0x7fc0140ca4d0 2024-03-19T06:39:29.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.069+0000 7fc012000640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca4d0 0x7fc014153dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc01415b030 tx=0x7fbffc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4415f200ebeeec server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:29.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.073+0000 7fc011600640 1 -- 172.21.15.17:0/3010542654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc034070 con 0x7fc0140ca4d0 2024-03-19T06:39:29.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.073+0000 7fc011600640 1 -- 172.21.15.17:0/3010542654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbffc030860 con 0x7fc0140ca4d0 2024-03-19T06:39:29.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.073+0000 7fc011600640 1 -- 172.21.15.17:0/3010542654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc030c50 con 0x7fc0140ca4d0 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 -- 172.21.15.17:0/3010542654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca4d0 msgr2=0x7fc014153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca4d0 0x7fc014153dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc01415b030 tx=0x7fbffc02b9a0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 -- 172.21.15.17:0/3010542654 shutdown_connections 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 --2- 172.21.15.17:0/3010542654 >> v2:172.21.15.153:3300/0 conn(0x7fc01406bd40 0x7fc014154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca4d0 0x7fc014153dd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 --2- 172.21.15.17:0/3010542654 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca0f0 0x7fc0140c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 -- 172.21.15.17:0/3010542654 >> 172.21.15.17:0/3010542654 conn(0x7fc0140670b0 msgr2=0x7fc014070920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:29.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 -- 172.21.15.17:0/3010542654 shutdown_connections 2024-03-19T06:39:29.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.074+0000 7fc019c00640 1 -- 172.21.15.17:0/3010542654 wait complete. 2024-03-19T06:39:29.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.076+0000 7fc019c00640 1 Processor -- start 2024-03-19T06:39:29.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.076+0000 7fc019c00640 1 -- start start 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01406bd40 0x7fc014152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca4d0 0x7fc0141510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c9b20 con 0x7fc0140ca0f0 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01406d1e0 con 0x7fc01406bd40 2024-03-19T06:39:29.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.077+0000 7fc019c00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140c8330 con 0x7fc0140ca4d0 2024-03-19T06:39:29.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.078+0000 7fc012000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.078+0000 7fc012000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54880/0 (socket says 172.21.15.17:54880) 2024-03-19T06:39:29.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.078+0000 7fc012000640 1 -- 172.21.15.17:0/2252927793 learned_addr learned my addr 172.21.15.17:0/2252927793 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:29.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.079+0000 7fc012a00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01406bd40 0x7fc014152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.079+0000 7fc013400640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca4d0 0x7fc0141510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.082+0000 7fc012000640 1 -- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca4d0 msgr2=0x7fc0141510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.082+0000 7fc012000640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca4d0 0x7fc0141510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.082+0000 7fc012000640 1 -- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01406bd40 msgr2=0x7fc014152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.082+0000 7fc012000640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01406bd40 0x7fc014152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:29.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.083+0000 7fc012000640 1 -- 172.21.15.17:0/2252927793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140ada10 con 0x7fc0140ca0f0 2024-03-19T06:39:29.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.085+0000 7fc012000640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000c00 tx=0x7fbffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.090+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc034040 con 0x7fc0140ca0f0 2024-03-19T06:39:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.090+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbffc030660 con 0x7fc0140ca0f0 2024-03-19T06:39:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.090+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0423f0 con 0x7fc0140ca0f0 2024-03-19T06:39:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.090+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140c2d60 con 0x7fc0140ca0f0 2024-03-19T06:39:29.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.090+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0140c2fe0 con 0x7fc0140ca0f0 2024-03-19T06:39:29.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.091+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc014069be0 con 0x7fc0140ca0f0 2024-03-19T06:39:29.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.115+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7fbffc037070 con 0x7fc0140ca0f0 2024-03-19T06:39:29.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.116+0000 7fc00aa00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 0x7fbff006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:29.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.117+0000 7fc012a00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 0x7fbff006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:29.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.118+0000 7fc012a00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 0x7fbff006e0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0040113e0 tx=0x7fc00400b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:29.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.251+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6727+0+0 (secure 0 0 0) 0x7fbffc079b80 con 0x7fc0140ca0f0 2024-03-19T06:39:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.430+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7fc0140c2d60 con 0x7fc0140ca0f0 2024-03-19T06:39:29.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:29.644+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0140c32c0 con 0x7fc0140ca0f0 2024-03-19T06:39:30.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.081+0000 7fc00aa00640 1 -- 172.21.15.17:0/2252927793 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbffc030830 con 0x7fc0140ca0f0 2024-03-19T06:39:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.085+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 msgr2=0x7fbff006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.085+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 0x7fbff006e0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc0040113e0 tx=0x7fc00400b040 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 msgr2=0x7fc0141562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000c00 tx=0x7fbffc0046c0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 shutdown_connections 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7fc0140ca4d0 0x7fc0141510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0140ca0f0 0x7fc0141562a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7fbff006bc20 0x7fbff006e0e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 --2- 172.21.15.17:0/2252927793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc01406bd40 0x7fc014152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 >> 172.21.15.17:0/2252927793 conn(0x7fc0140670b0 msgr2=0x7fc014153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 shutdown_connections 2024-03-19T06:39:30.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.086+0000 7fc019c00640 1 -- 172.21.15.17:0/2252927793 wait complete. 2024-03-19T06:39:30.093 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-19T06:39:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.343+0000 7f3f0dc00640 1 Processor -- start 2024-03-19T06:39:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.343+0000 7f3f0dc00640 1 -- start start 2024-03-19T06:39:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.345+0000 7f3f0dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f080c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.345+0000 7f3f0dc00640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f080cfb70 0x7f3f080ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.345+0000 7f3f0dc00640 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f080cb960 con 0x7f3f080ca390 2024-03-19T06:39:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.345+0000 7f3f0dc00640 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f080cbc40 con 0x7f3f080cfb70 2024-03-19T06:39:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.345+0000 7f3f0dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080cbf20 con 0x7f3f08153e00 2024-03-19T06:39:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.347+0000 7f3f0d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f080cfb70 0x7f3f080ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.348+0000 7f3f0d200640 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f080cfb70 0x7f3f080ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.17:46600/0 (socket says 172.21.15.17:46600) 2024-03-19T06:39:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.348+0000 7f3f0d200640 1 -- 172.21.15.17:0/391984930 learned_addr learned my addr 172.21.15.17:0/391984930 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:30.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.352+0000 7f3f07e00640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f080c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.359+0000 7f3f0d200640 1 -- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 msgr2=0x7f3f080c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.359+0000 7f3f0d200640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f080c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.359+0000 7f3f0d200640 1 -- 172.21.15.17:0/391984930 >> v1:172.21.15.153:6789/0 conn(0x7f3f080ca390 legacy=0x7f3f080cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-19T06:39:30.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.359+0000 7f3f0d200640 1 -- 172.21.15.17:0/391984930 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f080cc200 con 0x7f3f080cfb70 2024-03-19T06:39:30.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.368+0000 7f3f0d200640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f080ca7d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009870 tx=0x7f3f0002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58739b9cba0db3b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.400+0000 7f3f06a00640 1 -- 172.21.15.17:0/391984930 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00034070 con 0x7f3f080cfb70 2024-03-19T06:39:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.400+0000 7f3f06a00640 1 -- 172.21.15.17:0/391984930 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f00030840 con 0x7f3f080cfb70 2024-03-19T06:39:30.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.400+0000 7f3f06a00640 1 -- 172.21.15.17:0/391984930 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00030c30 con 0x7f3f080cfb70 2024-03-19T06:39:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 -- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 msgr2=0x7f3f080ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f080ca7d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009870 tx=0x7f3f0002b980 comp rx=0 tx=0).stop 2024-03-19T06:39:30.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 -- 172.21.15.17:0/391984930 shutdown_connections 2024-03-19T06:39:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f080ca7d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/391984930 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f080c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.401+0000 7f3f0dc00640 1 -- 172.21.15.17:0/391984930 >> 172.21.15.17:0/391984930 conn(0x7f3f0806d7f0 msgr2=0x7f3f08072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.402+0000 7f3f0dc00640 1 -- 172.21.15.17:0/391984930 shutdown_connections 2024-03-19T06:39:30.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.402+0000 7f3f0dc00640 1 -- 172.21.15.17:0/391984930 wait complete. 2024-03-19T06:39:30.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.404+0000 7f3f0dc00640 1 Processor -- start 2024-03-19T06:39:30.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.404+0000 7f3f0dc00640 1 -- start start 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 0x7f3f081498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f0814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080ccce0 con 0x7f3f080ca390 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080cc7c0 con 0x7f3f080cfb70 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.406+0000 7f3f0dc00640 1 -- --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815aa30 con 0x7f3f08153e00 2024-03-19T06:39:30.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.407+0000 7f3f0d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.407+0000 7f3f07e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 0x7f3f081498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.407+0000 7f3f07e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 0x7f3f081498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38122/0 (socket says 172.21.15.17:38122) 2024-03-19T06:39:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.407+0000 7f3f07e00640 1 -- 172.21.15.17:0/2572187325 learned_addr learned my addr 172.21.15.17:0/2572187325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-19T06:39:30.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.407+0000 7f3f0d200640 1 --2- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3301/0 says I am v2:172.21.15.17:51118/0 (socket says 172.21.15.17:51118) 2024-03-19T06:39:30.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.408+0000 7f3f07400640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f0814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.413+0000 7f3f0d200640 1 -- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 msgr2=0x7f3f0814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:30.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.413+0000 7f3f0d200640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f0814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.413+0000 7f3f0d200640 1 -- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 msgr2=0x7f3f081498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:30.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.413+0000 7f3f0d200640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 0x7f3f081498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:30.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.413+0000 7f3f0d200640 1 -- 172.21.15.17:0/2572187325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0814d0f0 con 0x7f3f08153e00 2024-03-19T06:39:30.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.415+0000 7f3f0d200640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f00033000 tx=0x7f3f00004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:30.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.420+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00048070 con 0x7f3f08153e00 2024-03-19T06:39:30.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.421+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f00030640 con 0x7f3f08153e00 2024-03-19T06:39:30.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.421+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00034040 con 0x7f3f08153e00 2024-03-19T06:39:30.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.421+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f081f2e70 con 0x7f3f08153e00 2024-03-19T06:39:30.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.421+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0814d670 con 0x7f3f08153e00 2024-03-19T06:39:30.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.422+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0804f050 con 0x7f3f08153e00 2024-03-19T06:39:30.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.449+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 4 ==== mgrmap(e 7) v1 ==== 90136+0+0 (secure 0 0 0) 0x7f3f0004b070 con 0x7f3f08153e00 2024-03-19T06:39:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.451+0000 7f3effe00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 0x7f3ee406e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-19T06:39:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.451+0000 7f3f07e00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 0x7f3ee406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-19T06:39:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.452+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f3f000307f0 con 0x7f3f08153e00 2024-03-19T06:39:30.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.453+0000 7f3f07e00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 0x7f3ee406e110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80094c0 tx=0x7f3ef800b040 comp rx=0 tx=0).ready entity=mgr.4138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-19T06:39:30.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.754+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183657 (secure 0 0 0) 0x7f3f00052020 con 0x7f3f08153e00 2024-03-19T06:39:30.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:30.970+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 --> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f08150c80 con 0x7f3f08153e00 2024-03-19T06:39:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.413+0000 7f3effe00640 1 -- 172.21.15.17:0/2572187325 <== mon.2 v2:172.21.15.153:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v36) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3f0007b460 con 0x7f3f08153e00 2024-03-19T06:39:31.398 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data_ec' removed 2024-03-19T06:39:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.416+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 msgr2=0x7f3ee406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.416+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 0x7f3ee406e110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80094c0 tx=0x7f3ef800b040 comp rx=0 tx=0).stop 2024-03-19T06:39:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.416+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 msgr2=0x7f3f081f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-19T06:39:31.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.416+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f00033000 tx=0x7f3f00004730 comp rx=0 tx=0).stop 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 shutdown_connections 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x7f3f08153e00 0x7f3f081f3630 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:6832/3774724855,v1:172.21.15.17:6833/3774724855] conn(0x7f3ee406bc50 0x7f3ee406e110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f080cfb70 0x7f3f0814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 --2- 172.21.15.17:0/2572187325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ca390 0x7f3f081498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 >> 172.21.15.17:0/2572187325 conn(0x7f3f0806d7f0 msgr2=0x7f3f081595f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-19T06:39:31.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 shutdown_connections 2024-03-19T06:39:31.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-19T06:39:31.417+0000 7f3f0dc00640 1 -- 172.21.15.17:0/2572187325 wait complete. 2024-03-19T06:39:31.430 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-19T06:39:31.430 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-19T06:39:31.430 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.430 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:39:31.430 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a" 2024-03-19T06:39:31.431 INFO:tasks.ceph.mds.a:Stopped 2024-03-19T06:39:31.431 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-19T06:39:31.431 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.432 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:39:31.432 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c" 2024-03-19T06:39:31.432 INFO:tasks.ceph.mds.c:Stopped 2024-03-19T06:39:31.432 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-19T06:39:31.432 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.432 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:39:31.432 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e" 2024-03-19T06:39:31.432 INFO:tasks.ceph.mds.e:Stopped 2024-03-19T06:39:31.433 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-19T06:39:31.433 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.433 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:39:31.433 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b" 2024-03-19T06:39:31.433 INFO:tasks.ceph.mds.b:Stopped 2024-03-19T06:39:31.433 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-19T06:39:31.433 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.433 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:39:31.433 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-03-19T06:39:31.434 INFO:tasks.ceph.mds.d:Stopped 2024-03-19T06:39:31.434 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-19T06:39:31.434 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:31.470 INFO:tasks.ceph.mds.f.smithi153.stderr:2024-03-19T06:39:31.460+0000 b5e4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 42066) UID: 0 2024-03-19T06:39:31.477 INFO:tasks.ceph.mds.f.smithi153.stderr:2024-03-19T06:39:31.465+0000 b5e4640 -1 mds.f *** got signal Terminated *** 2024-03-19T06:39:34.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-03-19T06:39:34.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-03-19T06:39:34.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-03-19T06:39:34.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-03-19T06:39:34.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-03-19T06:39:37.538 INFO:tasks.ceph.mds.f:Stopped 2024-03-19T06:39:37.538 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-19T06:39:37.539 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-19T06:39:37.539 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:37.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:39:37.556+0000 7f96b0c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 36987) UID: 0 2024-03-19T06:39:37.540 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-19T06:39:37.556+0000 7f96b0c00640 -1 osd.0 37 *** Got signal Terminated *** 2024-03-19T06:39:43.641 INFO:tasks.ceph.osd.0:Stopped 2024-03-19T06:39:43.641 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-19T06:39:43.641 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:43.643 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:39:43.658+0000 7f3a77c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 36989) UID: 0 2024-03-19T06:39:43.643 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-19T06:39:43.658+0000 7f3a77c00640 -1 osd.1 39 *** Got signal Terminated *** 2024-03-19T06:39:46.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-19T06:39:49.742 INFO:tasks.ceph.osd.1:Stopped 2024-03-19T06:39:49.743 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-19T06:39:49.743 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:49.744 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:39:49.760+0000 7fc298800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 36995) UID: 0 2024-03-19T06:39:49.744 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-19T06:39:49.760+0000 7fc298800640 -1 osd.2 40 *** Got signal Terminated *** 2024-03-19T06:39:52.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-19T06:39:52.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-19T06:39:55.845 INFO:tasks.ceph.osd.2:Stopped 2024-03-19T06:39:55.845 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-19T06:39:55.846 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:39:55.847 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:39:55.862+0000 7f69a9a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 36996) UID: 0 2024-03-19T06:39:55.847 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-19T06:39:55.862+0000 7f69a9a00640 -1 osd.3 41 *** Got signal Terminated *** 2024-03-19T06:39:57.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:39:57.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:39:58.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-19T06:39:58.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-19T06:40:01.947 INFO:tasks.ceph.osd.3:Stopped 2024-03-19T06:40:01.947 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-19T06:40:01.947 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:01.949 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:40:01.964+0000 7f34a8200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 37456) UID: 0 2024-03-19T06:40:01.949 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-03-19T06:40:01.964+0000 7f34a8200640 -1 osd.4 42 *** Got signal Terminated *** 2024-03-19T06:40:04.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-19T06:40:04.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-19T06:40:08.049 INFO:tasks.ceph.osd.4:Stopped 2024-03-19T06:40:08.050 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-19T06:40:08.050 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:08.051 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:40:08.066+0000 7f249da00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 37459) UID: 0 2024-03-19T06:40:08.052 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-03-19T06:40:08.066+0000 7f249da00640 -1 osd.5 43 *** Got signal Terminated *** 2024-03-19T06:40:10.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-19T06:40:14.151 INFO:tasks.ceph.osd.5:Stopped 2024-03-19T06:40:14.152 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-19T06:40:14.152 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:14.153 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:40:14.168+0000 7fc17f800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 37461) UID: 0 2024-03-19T06:40:14.154 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-03-19T06:40:14.168+0000 7fc17f800640 -1 osd.6 44 *** Got signal Terminated *** 2024-03-19T06:40:15.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-19T06:40:20.253 INFO:tasks.ceph.osd.6:Stopped 2024-03-19T06:40:20.254 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-19T06:40:20.254 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:20.255 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:40:20.270+0000 7fcab3400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 37463) UID: 0 2024-03-19T06:40:20.255 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-03-19T06:40:20.270+0000 7fcab3400640 -1 osd.7 44 *** Got signal Terminated *** 2024-03-19T06:40:21.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-19T06:40:21.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-19T06:40:26.356 INFO:tasks.ceph.osd.7:Stopped 2024-03-19T06:40:26.356 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-19T06:40:26.357 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-19T06:40:26.357 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:26.359 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:40:26.374+0000 7f9513000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 36689) UID: 0 2024-03-19T06:40:26.359 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-19T06:40:26.374+0000 7f9513000640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-19T06:40:26.445 INFO:tasks.ceph.mgr.y:Stopped 2024-03-19T06:40:26.445 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-19T06:40:26.445 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:26.540 INFO:tasks.ceph.mgr.x:Stopped 2024-03-19T06:40:26.540 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-19T06:40:26.541 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-19T06:40:26.541 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:26.585 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-03-19T06:40:26.567+0000 9f8f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 36686) UID: 0 2024-03-19T06:40:26.599 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-03-19T06:40:26.571+0000 9f8f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-19T06:40:26.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-19T06:40:27.547 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:27.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:27.662 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:34:56.666 36692== 2024-03-19T06:40:27.663 INFO:tasks.ceph.mon.a.smithi017.stderr:==00:00:34:56.666 36692== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:40:27.712 INFO:tasks.ceph.mon.a.smithi017.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:40:31.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-19T06:40:32.643 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:40:32.643 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-03-19T06:40:32.643 INFO:tasks.ceph.mon.a:Stopped 2024-03-19T06:40:32.644 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-19T06:40:32.644 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:32.689 INFO:tasks.ceph.mon.b.smithi153.stderr:2024-03-19T06:40:32.670+0000 9f8f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 36858) UID: 0 2024-03-19T06:40:32.690 INFO:tasks.ceph.mon.b.smithi153.stderr:2024-03-19T06:40:32.674+0000 9f8f640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-19T06:40:33.431 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:35:02.451 36864== 2024-03-19T06:40:33.432 INFO:tasks.ceph.mon.b.smithi153.stderr:==00:00:35:02.451 36864== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:40:33.472 INFO:tasks.ceph.mon.b.smithi153.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:40:36.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-03-19T06:40:36.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-19T06:40:38.745 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:40:38.746 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-03-19T06:40:38.746 INFO:tasks.ceph.mon.b:Stopped 2024-03-19T06:40:38.746 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-19T06:40:38.747 INFO:teuthology.orchestra.run:waiting for 300 2024-03-19T06:40:38.795 INFO:tasks.ceph.mon.c.smithi153.stderr:2024-03-19T06:40:38.772+0000 9f8f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 36860) UID: 0 2024-03-19T06:40:38.796 INFO:tasks.ceph.mon.c.smithi153.stderr:2024-03-19T06:40:38.777+0000 9f8f640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-03-19T06:40:39.549 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:35:08.569 36865== 2024-03-19T06:40:39.550 INFO:tasks.ceph.mon.c.smithi153.stderr:==00:00:35:08.569 36865== Exit program on first error (--exit-on-first-error=yes) 2024-03-19T06:40:39.591 INFO:tasks.ceph.mon.c.smithi153.stderr:daemon-helper: command failed with exit status 42 2024-03-19T06:40:41.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-19T06:40:41.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-03-19T06:40:44.849 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-03-19T06:40:44.849 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi153 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-03-19T06:40:44.849 INFO:tasks.ceph.mon.c:Stopped 2024-03-19T06:40:44.849 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-19T06:40:44.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-03-19T06:40:44.964 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:40:44.964 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-19T06:40:45.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:40:45.177 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-19T06:40:45.342 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:40:45.342 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-19T06:40:45.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:40:45.508 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-19T06:40:45.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:40:45.668 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-19T06:40:45.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:40:45.926 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-19T06:40:46.078 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:40:46.079 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-19T06:40:46.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:40:46.225 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-19T06:40:46.403 INFO:tasks.ceph:Archiving mon data... 2024-03-19T06:40:46.405 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/data/mon.a.tgz 2024-03-19T06:40:46.405 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-03-19T06:40:46.465 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.dseiqLYVUu 2024-03-19T06:40:46.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dseiqLYVUu 2024-03-19T06:40:46.663 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.dseiqLYVUu 2024-03-19T06:40:46.820 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.dseiqLYVUu is 381KB 2024-03-19T06:40:46.935 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.dseiqLYVUu 2024-03-19T06:40:46.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-19T06:40:46.994 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/data/mon.b.tgz 2024-03-19T06:40:46.995 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-19T06:40:47.052 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.VvTOGZeYeV 2024-03-19T06:40:47.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VvTOGZeYeV 2024-03-19T06:40:47.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.VvTOGZeYeV 2024-03-19T06:40:47.412 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.VvTOGZeYeV is 400KB 2024-03-19T06:40:47.523 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.VvTOGZeYeV 2024-03-19T06:40:47.577 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/data/mon.c.tgz 2024-03-19T06:40:47.577 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-03-19T06:40:47.627 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.zb8xt1GzQR 2024-03-19T06:40:47.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zb8xt1GzQR 2024-03-19T06:40:47.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.zb8xt1GzQR 2024-03-19T06:40:47.951 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.zb8xt1GzQR is 400KB 2024-03-19T06:40:48.060 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.zb8xt1GzQR 2024-03-19T06:40:48.117 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-19T06:40:48.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-19T06:40:48.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-19T06:40:48.608 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-19T06:40:48.972 INFO:tasks.ceph:Archiving crash dumps... 2024-03-19T06:40:48.974 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi017/crash 2024-03-19T06:40:48.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-19T06:40:49.078 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi153/crash 2024-03-19T06:40:49.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-19T06:40:49.169 INFO:tasks.ceph:Shutting down logrotate 2024-03-19T06:40:49.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:49.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:49.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:49.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-19T06:40:49.505 INFO:tasks.ceph:Compressing logs... 2024-03-19T06:40:49.505 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:40:49.514 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-19T06:40:49.605 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-19T06:40:49.607 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-03-19T06:40:49.607 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-03-19T06:40:49.608 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-03-19T06:40:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42994.log 2024-03-19T06:40:49.609 INFO:teuthology.orchestra.run.smithi153.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-03-19T06:40:49.610 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mds.f.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-03-19T06:40:49.610 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-03-19T06:40:49.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-03-19T06:40:49.646 INFO:teuthology.orchestra.run.smithi153.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37286.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37286.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.37286.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37155.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37155.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37155.log.gz 2024-03-19T06:40:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37326.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.37326.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37326.log.gz 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37199.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37199.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37199.log.gz 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-03-19T06:40:49.648 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.37115.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-19T06:40:49.652 INFO:teuthology.orchestra.run.smithi153.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-03-19T06:40:49.652 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37246.log 2024-03-19T06:40:49.652 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-19T06:40:49.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37366.log 2024-03-19T06:40:49.653 INFO:teuthology.orchestra.run.smithi153.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37246.log.gz 2024-03-19T06:40:49.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.37366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37366.log.gz 2024-03-19T06:40:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41564.log 2024-03-19T06:40:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42994.log.gz 2024-03-19T06:40:49.655 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45600.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41564.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48755.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45600.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49034.log 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-03-19T06:40:49.656 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48989.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49034.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44713.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48989.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46330.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44713.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45366.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.46330.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mds.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr: 67.7% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-03-19T06:40:49.657 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mds.a.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/client.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr: 76.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/valgrind/mds.e.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41692.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48301.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48301.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2024-03-19T06:40:49.658 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44288.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41650.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48259.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44288.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43923.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41650.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43438.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48259.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49160.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43923.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44265.log 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43438.log.gz 2024-03-19T06:40:49.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50161.log 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49160.log.gz 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44265.log.gz 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50161.log.gz 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41986.log 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45666.log 2024-03-19T06:40:49.660 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-03-19T06:40:49.661 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mds.d.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-19T06:40:49.661 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-19T06:40:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45096.log 2024-03-19T06:40:49.663 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41986.log.gz 2024-03-19T06:40:49.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43700.log 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45666.log.gz 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45096.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45096.log.gz 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41429.log 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49412.log 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43700.log.gz 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50203.log 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41429.log.gz 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49076.log 2024-03-19T06:40:49.664 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49412.log.gz 2024-03-19T06:40:49.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43036.log 2024-03-19T06:40:49.665 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50203.log.gz 2024-03-19T06:40:49.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43258.log 2024-03-19T06:40:49.666 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49076.log.gz 2024-03-19T06:40:49.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2024-03-19T06:40:49.667 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43036.log.gz 2024-03-19T06:40:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49581.log 2024-03-19T06:40:49.668 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43258.log.gz 2024-03-19T06:40:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50101.log 2024-03-19T06:40:49.670 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2024-03-19T06:40:49.671 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49623.log 2024-03-19T06:40:49.671 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49581.log.gz 2024-03-19T06:40:49.672 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50101.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-19T06:40:49.672 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50101.log.gz 2024-03-19T06:40:49.673 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-03-19T06:40:49.674 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49623.log.gz 2024-03-19T06:40:49.675 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48487.log 2024-03-19T06:40:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48713.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-19T06:40:49.676 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-03-19T06:40:49.677 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-03-19T06:40:49.678 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45180.log 2024-03-19T06:40:49.678 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48487.log.gz 2024-03-19T06:40:49.680 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-03-19T06:40:49.680 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-03-19T06:40:49.681 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2024-03-19T06:40:49.681 INFO:teuthology.orchestra.run.smithi017.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45180.log.gz 2024-03-19T06:40:49.682 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45732.log 2024-03-19T06:40:49.682 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz 2024-03-19T06:40:49.683 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-03-19T06:40:49.683 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2024-03-19T06:40:49.684 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41836.log 2024-03-19T06:40:49.685 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41471.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45732.log.gz 2024-03-19T06:40:49.686 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44844.log 2024-03-19T06:40:49.686 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-03-19T06:40:49.687 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2024-03-19T06:40:49.687 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41836.log.gz 2024-03-19T06:40:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48939.log 2024-03-19T06:40:49.689 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44844.log.gz 2024-03-19T06:40:49.690 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-03-19T06:40:49.690 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2024-03-19T06:40:49.691 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2024-03-19T06:40:49.691 INFO:teuthology.orchestra.run.smithi017.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48939.log.gz 2024-03-19T06:40:49.692 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43522.log 2024-03-19T06:40:49.693 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-03-19T06:40:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-03-19T06:40:49.695 INFO:teuthology.orchestra.run.smithi017.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz 2024-03-19T06:40:49.696 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-03-19T06:40:49.696 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43522.log.gz 2024-03-19T06:40:49.697 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48343.log 2024-03-19T06:40:49.697 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-03-19T06:40:49.709 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42768.log 2024-03-19T06:40:49.709 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49286.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48343.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43354.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42768.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49286.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44490.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43354.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49202.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45138.log 2024-03-19T06:40:49.710 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2024-03-19T06:40:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2024-03-19T06:40:49.711 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2024-03-19T06:40:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45138.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-19T06:40:49.711 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45138.log.gz 2024-03-19T06:40:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42852.log 2024-03-19T06:40:49.712 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2024-03-19T06:40:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41172.log 2024-03-19T06:40:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42852.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42852.log.gz 2024-03-19T06:40:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41261.log 2024-03-19T06:40:49.714 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44236.log 2024-03-19T06:40:49.715 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41172.log: /var/log/ceph/ceph-client.admin.41261.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41172.log.gz 2024-03-19T06:40:49.715 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41018.log 2024-03-19T06:40:49.715 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41261.log.gz 2024-03-19T06:40:49.716 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-03-19T06:40:49.717 INFO:teuthology.orchestra.run.smithi017.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44236.log.gz 2024-03-19T06:40:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-03-19T06:40:49.718 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41018.log.gz 2024-03-19T06:40:49.719 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45450.log 2024-03-19T06:40:49.720 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-03-19T06:40:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-19T06:40:49.721 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41734.log 2024-03-19T06:40:49.722 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40976.log 2024-03-19T06:40:49.722 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45450.log.gz 2024-03-19T06:40:49.723 INFO:teuthology.orchestra.run.smithi017.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-03-19T06:40:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2024-03-19T06:40:49.724 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41734.log.gz 2024-03-19T06:40:49.725 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44220.log 2024-03-19T06:40:49.726 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40976.log.gz 2024-03-19T06:40:49.726 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44970.log 2024-03-19T06:40:49.727 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2024-03-19T06:40:49.728 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42910.log 2024-03-19T06:40:49.728 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44220.log.gz 2024-03-19T06:40:49.729 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49454.log 2024-03-19T06:40:49.729 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44970.log.gz 2024-03-19T06:40:49.730 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42910.log.gz 2024-03-19T06:40:49.731 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49118.log 2024-03-19T06:40:49.732 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-03-19T06:40:49.732 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49454.log.gz 2024-03-19T06:40:49.733 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2024-03-19T06:40:49.733 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49118.log.gz 2024-03-19T06:40:49.735 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-03-19T06:40:49.735 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-03-19T06:40:49.736 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43078.log 2024-03-19T06:40:49.736 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2024-03-19T06:40:49.738 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2024-03-19T06:40:49.738 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-03-19T06:40:49.739 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50059.log 2024-03-19T06:40:49.739 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43078.log.gz 2024-03-19T06:40:49.740 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42642.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-19T06:40:49.740 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2024-03-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2024-03-19T06:40:49.741 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50059.log.gz 2024-03-19T06:40:49.743 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45054.log 2024-03-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-03-19T06:40:49.744 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2024-03-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2024-03-19T06:40:49.745 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45054.log.gz 2024-03-19T06:40:49.746 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48896.log 2024-03-19T06:40:49.746 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-03-19T06:40:49.747 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41345.log 2024-03-19T06:40:49.748 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2024-03-19T06:40:49.749 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37002.log 2024-03-19T06:40:49.749 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48896.log.gz 2024-03-19T06:40:49.751 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-03-19T06:40:49.751 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41345.log.gz 2024-03-19T06:40:49.752 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43301.log 2024-03-19T06:40:49.752 INFO:teuthology.orchestra.run.smithi017.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37002.log.gz 2024-03-19T06:40:49.754 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2024-03-19T06:40:49.754 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-03-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi153.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41608.log 2024-03-19T06:40:49.755 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43301.log.gz 2024-03-19T06:40:49.757 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43120.log 2024-03-19T06:40:49.757 INFO:teuthology.orchestra.run.smithi017.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2024-03-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41608.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-03-19T06:40:49.758 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41608.log.gz 2024-03-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42726.log 2024-03-19T06:40:49.759 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43120.log.gz 2024-03-19T06:40:49.760 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50017.log 2024-03-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2024-03-19T06:40:49.762 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42726.log.gz 2024-03-19T06:40:49.763 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.50017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40812.log 2024-03-19T06:40:49.764 INFO:teuthology.orchestra.run.smithi017.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50017.log.gz 2024-03-19T06:40:49.764 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37113.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-19T06:40:49.765 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2024-03-19T06:40:49.766 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48629.log 2024-03-19T06:40:49.766 INFO:teuthology.orchestra.run.smithi017.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40812.log.gz 2024-03-19T06:40:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41776.log 2024-03-19T06:40:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48629.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48629.log.gz 2024-03-19T06:40:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41776.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41776.log.gz 2024-03-19T06:40:49.771 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44886.log 2024-03-19T06:40:49.772 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42952.log 2024-03-19T06:40:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44886.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44886.log.gz 2024-03-19T06:40:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.42952.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42952.log.gz 2024-03-19T06:40:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49975.log 2024-03-19T06:40:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2024-03-19T06:40:49.779 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49975.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49975.log.gz 2024-03-19T06:40:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41387.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2024-03-19T06:40:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2024-03-19T06:40:49.782 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41517.log 2024-03-19T06:40:49.783 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49707.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2024-03-19T06:40:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41517.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.41517.log.gz 2024-03-19T06:40:49.785 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-19T06:40:49.787 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30678.log 2024-03-19T06:40:49.789 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph.tmp-client.admin.30678.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30678.log.gz 2024-03-19T06:40:49.790 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2024-03-19T06:40:49.792 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44928.log 2024-03-19T06:40:49.794 INFO:teuthology.orchestra.run.smithi017.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2024-03-19T06:40:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49496.log 2024-03-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44928.log: /var/log/ceph/ceph-client.admin.49496.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-03-19T06:40:49.800 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44928.log.gz 2024-03-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-03-19T06:40:49.801 INFO:teuthology.orchestra.run.smithi017.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49496.log.gz 2024-03-19T06:40:49.805 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44526.log: /var/log/ceph/ceph-client.admin.41303.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2024-03-19T06:40:49.806 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-03-19T06:40:49.807 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-03-19T06:40:49.809 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2024-03-19T06:40:49.812 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43931.log: /var/log/ceph/ceph-client.admin.49933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49809.log 2024-03-19T06:40:49.813 INFO:teuthology.orchestra.run.smithi017.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-19T06:40:49.814 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2024-03-19T06:40:49.815 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2024-03-19T06:40:49.816 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43657.log 2024-03-19T06:40:49.820 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.49809.log: /var/log/ceph/ceph-client.admin.43657.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43657.log.gz 2024-03-19T06:40:49.822 INFO:teuthology.orchestra.run.smithi017.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-03-19T06:40:49.822 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49809.log.gz 2024-03-19T06:40:49.823 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-19T06:40:49.827 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41078.log 2024-03-19T06:40:49.830 INFO:teuthology.orchestra.run.smithi017.stderr: 87.8%/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-19T06:40:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41078.log: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-19T06:40:49.831 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-03-19T06:40:49.833 INFO:teuthology.orchestra.run.smithi017.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43396.log 2024-03-19T06:40:49.834 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48587.log 2024-03-19T06:40:49.834 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41078.log.gz 2024-03-19T06:40:49.837 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.48587.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48587.log.gz 2024-03-19T06:40:49.838 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43396.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43396.log.gz 2024-03-19T06:40:49.839 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40730.log 2024-03-19T06:40:49.840 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44179.log 2024-03-19T06:40:49.843 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44179.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44179.log.gz 2024-03-19T06:40:49.843 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36691.log 2024-03-19T06:40:49.846 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40730.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-03-19T06:40:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36691.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.36691.log.gz 2024-03-19T06:40:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43927.log 2024-03-19T06:40:49.852 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43927.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43927.log.gz 2024-03-19T06:40:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41219.log 2024-03-19T06:40:49.856 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44300.log 2024-03-19T06:40:49.861 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41219.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41219.log.gz 2024-03-19T06:40:49.862 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2024-03-19T06:40:49.864 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44300.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44300.log.gz 2024-03-19T06:40:49.865 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49328.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2024-03-19T06:40:49.865 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43198.log 2024-03-19T06:40:49.869 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49370.log 2024-03-19T06:40:49.870 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43198.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43198.log.gz 2024-03-19T06:40:49.871 INFO:teuthology.orchestra.run.smithi017.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-03-19T06:40:49.872 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2024-03-19T06:40:49.876 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49370.log: /var/log/ceph/ceph-client.admin.45926.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49370.log.gz 2024-03-19T06:40:49.876 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2024-03-19T06:40:49.878 INFO:teuthology.orchestra.run.smithi017.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-03-19T06:40:49.879 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.48403.log: -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2024-03-19T06:40:49.881 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2024-03-19T06:40:49.881 INFO:teuthology.orchestra.run.smithi017.stderr: -- /var/log/ceph/ceph-client.admin.49244.log 2024-03-19T06:40:49.881 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.44614.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-03-19T06:40:49.884 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49538.log 2024-03-19T06:40:49.884 INFO:teuthology.orchestra.run.smithi017.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49244.log.gz 2024-03-19T06:40:49.886 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-03-19T06:40:49.891 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.49538.log: /var/log/ceph/ceph-client.admin.42684.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45012.log 2024-03-19T06:40:49.891 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49538.log.gz 2024-03-19T06:40:49.893 INFO:teuthology.orchestra.run.smithi017.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-03-19T06:40:49.894 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.45012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-19T06:40:49.895 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2024-03-19T06:40:49.897 INFO:teuthology.orchestra.run.smithi017.stderr: 87.4%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.45012.log.gz 2024-03-19T06:40:49.901 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.43919.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2024-03-19T06:40:50.010 INFO:teuthology.orchestra.run.smithi017.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-19T06:40:50.155 INFO:teuthology.orchestra.run.smithi153.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-19T06:40:50.181 INFO:teuthology.orchestra.run.smithi017.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-19T06:40:50.256 INFO:teuthology.orchestra.run.smithi153.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-19T06:40:51.210 INFO:teuthology.orchestra.run.smithi017.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-19T06:40:51.552 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-19T06:40:51.910 INFO:teuthology.orchestra.run.smithi017.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-19T06:40:52.295 INFO:teuthology.orchestra.run.smithi153.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-19T06:40:52.297 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-19T06:40:52.614 INFO:teuthology.orchestra.run.smithi153.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-19T06:40:52.618 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-03-19T06:40:52.618 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m3.053s 2024-03-19T06:40:52.618 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m10.812s 2024-03-19T06:40:52.618 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m0.951s 2024-03-19T06:40:52.650 INFO:teuthology.orchestra.run.smithi017.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-19T06:40:53.552 INFO:teuthology.orchestra.run.smithi017.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-19T06:40:53.609 INFO:teuthology.orchestra.run.smithi017.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-19T06:40:55.103 INFO:teuthology.orchestra.run.smithi017.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.46330.log.gz 2024-03-19T06:41:00.527 INFO:teuthology.orchestra.run.smithi017.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-19T06:41:00.532 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-03-19T06:41:00.532 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m10.969s 2024-03-19T06:41:00.533 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m28.939s 2024-03-19T06:41:00.533 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m2.493s 2024-03-19T06:41:00.534 INFO:tasks.ceph:Archiving logs... 2024-03-19T06:41:00.535 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi017/log 2024-03-19T06:41:00.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:41:04.956 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi153/log 2024-03-19T06:41:04.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-19T06:41:06.821 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-19T06:41:06.823 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-19T06:41:06.851 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_b0ea271bb96f7f4cec2f2a40ff88a5def1e0530f/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-19T06:41:06.853 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-19T06:41:06.853 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:41:06.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-19T06:41:07.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-19T06:41:07.070 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-19T06:41:07.071 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:41:07.082 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-19T06:41:07.130 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-19T06:41:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-19T06:41:07.140 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T06:41:07.140 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-19T06:41:07.140 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 +488us[ +485us] +/- 84ms 2024-03-19T06:41:07.141 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 32 -1760us[-1763us] +/- 66ms 2024-03-19T06:41:07.141 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +2800us[+2800us] +/- 70ms 2024-03-19T06:41:07.141 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 +274us[ +525us] +/- 84ms 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 7 377 27 -1936us[-1685us] +/- 66ms 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +2568us[+2819us] +/- 70ms 2024-03-19T06:41:07.147 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-19T06:41:07.149 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-19T06:41:07.197 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-19T06:41:07.198 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-19T06:41:07.249 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-19T06:41:07.474 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-19T06:41:07.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T06:41:07.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:41:07.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-19T06:41:07.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:41:07.931 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-19T06:41:07.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-19T06:41:07.970 INFO:teuthology.task.internal:Duration was 3129.932055 seconds 2024-03-19T06:41:07.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-19T06:41:08.018 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-19T06:41:08.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:41:08.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-19T06:41:08.202 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T06:41:08.205 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-19T06:41:08.535 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-19T06:41:08.535 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-03-19T06:41:08.536 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:41:08.605 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-03-19T06:41:08.606 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-19T06:41:08.681 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-19T06:41:08.681 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:41:08.689 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-19T06:41:08.787 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-19T06:41:08.787 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:41:08.794 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-19T06:41:09.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-19T06:41:09.172 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-19T06:41:09.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:41:09.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-19T06:41:09.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-19T06:41:09.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:41:09.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:41:09.518 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-03-19T06:41:09.519 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-03-19T06:41:09.577 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:41:09.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:41:09.628 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-19T06:41:09.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-19T06:41:09.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-19T06:41:09.694 INFO:teuthology.task.internal:Transferring archived files... 2024-03-19T06:41:09.695 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi017 2024-03-19T06:41:09.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:41:09.810 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654/remote/smithi153 2024-03-19T06:41:09.811 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-19T06:41:09.916 INFO:teuthology.task.internal:Removing archive directory... 2024-03-19T06:41:09.917 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:41:09.925 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-19T06:41:09.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-19T06:41:09.991 INFO:teuthology.task.internal:Not uploading archives. 2024-03-19T06:41:09.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-19T06:41:10.105 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-19T06:41:10.105 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:41:10.113 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-19T06:41:10.166 INFO:teuthology.orchestra.run.smithi017.stdout: 395173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 19 06:41 /home/ubuntu/cephtest 2024-03-19T06:41:10.168 INFO:teuthology.orchestra.run.smithi153.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 19 06:41 /home/ubuntu/cephtest 2024-03-19T06:41:10.171 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-19T06:41:10.183 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-19T06:41:10.207 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-03-19T06:41:10.207 INFO:teuthology.nuke:Checking targets against current locks 2024-03-19T06:41:10.231 DEBUG:teuthology.nuke:shortname: smithi017 2024-03-19T06:41:10.231 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:41:10.253 DEBUG:teuthology.nuke:shortname: smithi153 2024-03-19T06:41:10.253 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-19T06:41:10.257 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:37:40.481176', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEhv7qFZyWRdrRw/kQhLCjydPW/ut9Wadvozb5N1CCcNB2M95CrukWaHtca0MwA30ZUD5cuffW1pjmlPgIVM7+k='} 2024-03-19T06:41:10.276 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-03-19_04:59:54-fs-wip-vshankar-testing-20240307.022905-testing-default-smithi/7610654', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-19 05:37:40.479356', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBtcYq0LvT3OOwvk04JWyKVOO+iL1IlO1BdewEMONovlw/INthFFF9ocNr0LDRcmAHlmoQHb8T4U7lz7Jd8DvY='} 2024-03-19T06:41:10.302 INFO:teuthology.orchestra.console.smithi017:Power off 2024-03-19T06:41:10.303 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:41:10.329 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-03-19T06:41:10.330 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:10.349 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-19T06:41:10.350 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T06:41:10.360 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-19T06:41:10.372 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-03-19T06:41:10.372 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:10.396 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-19T06:41:14.362 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:14.396 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:14.475 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-19T06:41:14.508 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-19T06:41:18.477 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:18.509 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T06:41:18.588 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-19T06:41:18.619 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-19T06:41:18.688 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-03-19T06:41:18.720 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-19T06:41:18.825 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} duration: 3129.932055234909 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default mon.a-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 mon.b-kernel-sha1: 908b6b276e8f14e16032b32a9770077cd37b6bd4 owner: scheduled_vshankar@teuthology status: fail success: false 2024-03-19T06:41:18.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T06:41:18.953 INFO:teuthology.run:FAIL